-- Logs begin at Wed 2022-08-10 10:38:59 UTC, end at Wed 2022-08-10 11:53:17 UTC. -- Aug 10 11:24:14.068679 dv-cinder-852725-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 10 11:24:14.077359 dv-cinder-852725-3-iscsi devstack@n-api.service[103522]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 10 11:24:14.083766 dv-cinder-852725-3-iscsi devstack@n-api.service[103522]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 10 11:24:14 2022] *** Aug 10 11:24:14.083766 dv-cinder-852725-3-iscsi devstack@n-api.service[103522]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 10 11:24:14.083766 dv-cinder-852725-3-iscsi devstack@n-api.service[103522]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 10 11:24:14.083766 dv-cinder-852725-3-iscsi devstack@n-api.service[103522]: nodename: dv-cinder-852725-3-iscsi Aug 10 11:24:14.083766 dv-cinder-852725-3-iscsi devstack@n-api.service[103522]: machine: x86_64 Aug 10 11:24:14.083766 dv-cinder-852725-3-iscsi devstack@n-api.service[103522]: clock source: unix Aug 10 11:24:14.083766 dv-cinder-852725-3-iscsi devstack@n-api.service[103522]: pcre jit disabled Aug 10 11:24:14.083766 dv-cinder-852725-3-iscsi devstack@n-api.service[103522]: detected number of CPU cores: 4 Aug 10 11:24:14.083766 dv-cinder-852725-3-iscsi devstack@n-api.service[103522]: current working directory: / Aug 10 11:24:14.083766 dv-cinder-852725-3-iscsi devstack@n-api.service[103522]: detected binary path: /usr/bin/uwsgi-core Aug 10 11:24:14.083766 dv-cinder-852725-3-iscsi devstack@n-api.service[103522]: your processes number limit is 47680 Aug 10 11:24:14.083766 dv-cinder-852725-3-iscsi devstack@n-api.service[103522]: your memory page size is 4096 bytes Aug 10 11:24:14.083766 dv-cinder-852725-3-iscsi devstack@n-api.service[103522]: detected max file descriptor number: 2048 Aug 10 11:24:14.083766 dv-cinder-852725-3-iscsi devstack@n-api.service[103522]: lock engine: pthread robust mutexes Aug 10 11:24:14.083766 dv-cinder-852725-3-iscsi devstack@n-api.service[103522]: thunder lock: enabled Aug 10 11:24:14.083766 dv-cinder-852725-3-iscsi devstack@n-api.service[103522]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 10 11:24:14.083766 dv-cinder-852725-3-iscsi devstack@n-api.service[103522]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 10 11:24:14.120477 dv-cinder-852725-3-iscsi devstack@n-api.service[103522]: Python main interpreter initialized at 0x55d13f89f9c0 Aug 10 11:24:14.120477 dv-cinder-852725-3-iscsi devstack@n-api.service[103522]: python threads support enabled Aug 10 11:24:14.120477 dv-cinder-852725-3-iscsi devstack@n-api.service[103522]: your server socket listen backlog is limited to 100 connections Aug 10 11:24:14.120477 dv-cinder-852725-3-iscsi devstack@n-api.service[103522]: your mercy for graceful operations on workers is 90 seconds Aug 10 11:24:14.120871 dv-cinder-852725-3-iscsi devstack@n-api.service[103522]: mapped 403077 bytes (393 KB) for 2 cores Aug 10 11:24:14.120968 dv-cinder-852725-3-iscsi devstack@n-api.service[103522]: *** Operational MODE: preforking *** Aug 10 11:24:14.121160 dv-cinder-852725-3-iscsi devstack@n-api.service[103522]: *** uWSGI is running in multiple interpreter mode *** Aug 10 11:24:14.121160 dv-cinder-852725-3-iscsi devstack@n-api.service[103522]: spawned uWSGI master process (pid: 103522) Aug 10 11:24:14.121374 dv-cinder-852725-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 10 11:24:14.131989 dv-cinder-852725-3-iscsi devstack@n-api.service[103522]: spawned uWSGI worker 1 (pid: 103523, cores: 1) Aug 10 11:24:14.131989 dv-cinder-852725-3-iscsi devstack@n-api.service[103522]: spawned uWSGI worker 2 (pid: 103524, cores: 1) Aug 10 11:24:14.131989 dv-cinder-852725-3-iscsi devstack@n-api.service[103522]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 10 11:24:14.801074 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 11:24:14.802743 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 11:24:15.889485 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 11:24:15.889485 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: from cryptography.utils import int_from_bytes Aug 10 11:24:15.890155 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 11:24:15.890155 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: from cryptography.utils import int_from_bytes Aug 10 11:24:15.955155 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 11:24:15.955155 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: from cryptography.utils import int_from_bytes Aug 10 11:24:15.955875 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 11:24:15.955875 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: from cryptography.utils import int_from_bytes Aug 10 11:24:18.377070 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 11:24:18.377630 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 11:24:18.377822 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 11:24:18.378174 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 11:24:18.378425 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 11:24:18.378813 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.379149 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.379463 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.379775 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.380119 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.380213 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 11:24:18.380607 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.380681 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 11:24:18.380764 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.380951 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 11:24:18.381131 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.381859 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 11:24:18.382031 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.382114 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 11:24:18.382214 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.382421 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.382553 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.382724 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852725-3-iscsi {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.382877 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.383037 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.383202 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.383336 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.383523 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.383637 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.383857 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.383954 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.384207 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.384307 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.384532 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.384629 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.384851 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.384946 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.385177 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.385342 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.385447 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.386901 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.387120 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.387307 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852725-3-iscsi {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.387520 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.387520 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.387844 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.387844 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.388277 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.388465 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.388652 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.388856 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.389036 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.389236 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.389424 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.389576 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.389803 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.389955 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.390143 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.390143 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.390549 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.390744 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852725-3-iscsi {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.390942 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.391121 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.391282 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.391504 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.391663 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.391859 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.392044 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.392214 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.392352 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.392493 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.392656 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.392784 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.392924 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.393051 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.393183 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.393339 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.393467 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.393591 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.393736 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.393863 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.393999 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852725-3-iscsi {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.394125 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.394250 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.394382 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.394521 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.394686 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.394822 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.394955 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.395089 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.395215 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.395340 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.395474 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.395606 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.395732 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.395857 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.395998 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.396126 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.396273 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.396273 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.396519 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.396645 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.396824 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.396959 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.397103 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.397221 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.397397 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.397527 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.397654 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.397788 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.397916 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.398054 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.398183 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.398308 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.398434 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.398434 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.398689 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.398827 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.398962 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.398962 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.399210 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.399336 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.399467 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.399593 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.399728 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.399861 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.400015 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.400153 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.400280 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.400405 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.400537 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.400671 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.400807 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.400934 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.401200 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.401345 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.401473 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.401615 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.401789 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.401919 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.402044 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.402178 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.402307 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.402307 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.402563 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.402689 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.402814 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.402814 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.403062 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.403062 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.403320 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.403456 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.403582 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.403707 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.403914 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.404075 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.404202 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.404327 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.404453 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.404578 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.404717 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.404844 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.404969 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.404969 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.405217 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.405349 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.405485 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.405613 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.405737 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.405869 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.405994 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.406126 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.406266 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.406399 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.406526 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.406662 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.406788 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.406932 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.407091 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.407221 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.407413 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.407544 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.407722 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.407865 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.408055 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.408186 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.408352 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.408490 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.408660 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.408797 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.408962 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.409099 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.409263 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.409391 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.409517 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.409651 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.409809 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.409947 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.410117 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.410247 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.410415 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.410555 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.410713 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.410849 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.411026 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.411155 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.411330 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.411466 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.411627 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.411764 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.411926 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.412077 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.412251 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.412431 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.412599 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.412781 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.412965 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.413105 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.413310 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.413440 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.413619 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.413760 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.413927 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.414055 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.414222 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.414360 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.414529 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.414668 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.414849 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.414980 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.415147 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.415276 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.415446 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.415584 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.415754 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.415882 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.416079 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.416208 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.416362 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.416501 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.416672 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.416803 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.416972 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.417104 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.417271 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.417400 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.417568 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.417711 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.417866 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.418003 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.418163 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.418302 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.418461 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.418599 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.418757 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.418885 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.419052 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.419182 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.419345 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.419484 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.419655 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.419782 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.419983 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.420127 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.420286 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.420427 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.420587 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.420717 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.420886 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.421015 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.421188 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.421326 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.421492 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.421629 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.421795 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.421934 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.422099 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.422232 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.422401 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.422538 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.422703 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.422832 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.423003 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.423134 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.423319 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.423456 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.423640 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.423770 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.423947 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.424113 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.424282 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.424413 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.424590 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.424727 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.424899 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.425028 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:24:18.425207 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.425345 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.425523 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.425666 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.425838 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.425967 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.426161 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.426291 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.426473 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.426612 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.426784 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.426922 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.427098 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.427228 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.427405 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.427545 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.427718 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.428511 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.428661 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.428796 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.428931 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.429095 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.429235 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.429415 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.429546 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.429730 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.429874 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.430054 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.430194 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.430375 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.430505 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.430706 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.430845 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.431031 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.431169 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.431350 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.431481 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.431652 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.431791 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.431989 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.432121 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.432307 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.432452 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.432612 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.432751 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.432927 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.433048 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.433233 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.433404 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.433599 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.433739 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.433868 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.433994 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.434120 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.434246 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.434411 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.434542 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.434744 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.434883 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.435053 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.435184 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.435365 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.435496 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.435672 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.435802 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.436001 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.436134 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.436312 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.436453 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.436616 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.436754 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.436921 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.437051 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.437219 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.437356 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.437517 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.437647 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.437815 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.437955 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.438116 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.438247 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.438413 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.438543 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.438723 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.438867 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.439040 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.439177 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.439340 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.439461 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.439652 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.439795 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.439949 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.440122 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.440260 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.440388 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.440563 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.440703 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.440867 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.440997 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.441166 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.441289 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.441471 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.441610 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.441774 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.441903 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.442071 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.442201 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.442376 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.442505 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.442679 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.442807 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.442975 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.443105 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.443289 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.443433 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.444175 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.444317 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.444507 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.444649 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.444823 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.444954 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.445137 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.445267 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.445451 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.445582 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.445757 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.445887 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.446065 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.446200 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.446375 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.446517 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.446681 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.446810 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.446989 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.447113 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.447302 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.447441 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.447606 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.447736 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.447914 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.448061 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.448244 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.448386 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.448549 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.448680 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.448864 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.449006 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.449144 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.449280 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.449453 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.449583 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.449754 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.449884 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.450106 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.450245 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.450371 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.450497 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.450646 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.450775 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.450943 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.451074 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.451241 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.451379 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.451538 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.451679 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.451820 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.451948 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.452135 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.452262 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.452447 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.452587 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.452750 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.452881 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.453047 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.453185 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.453346 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.453553 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.453694 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.453820 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.453964 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.454095 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.454262 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.454400 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.454595 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.454724 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.454899 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.455036 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.455204 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.455344 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.455509 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.455639 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.455812 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.455941 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.456138 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.456282 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.456442 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.456577 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.456745 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.456872 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.457048 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.457178 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.457353 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.457490 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.457658 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.457787 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.457960 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.458089 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.458273 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.458444 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.458579 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.458755 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.458918 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.459048 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.459174 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.459300 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.459491 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.459675 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.459815 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.460101 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.460237 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.460423 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.460553 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.460741 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.460873 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.461050 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.461186 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.461360 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.461488 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.461664 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.461793 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.461975 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.462105 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.462277 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.462407 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.462581 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.462718 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.462886 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.463008 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.463189 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.463318 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.463500 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.463630 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.463803 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.463932 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.464131 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.464269 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.464435 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.464571 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.464755 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.464891 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.465056 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.465200 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.465365 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.465508 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.465661 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.465790 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.465967 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.466106 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.466286 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.466417 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.466592 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.466720 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.466899 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.467036 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.467202 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.467333 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.467508 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.467636 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.467809 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.467950 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.468135 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.468260 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.468428 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.468558 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.468726 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.468856 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.469023 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.469153 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.469327 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.469457 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.469633 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.469764 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.469931 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.470060 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.470235 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.470363 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.470533 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.470665 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.470841 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.470970 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.471145 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.471274 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.471442 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.471573 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.471738 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.471868 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.472080 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.472226 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.472362 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.472496 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.472658 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.472801 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.472958 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.473095 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.473260 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.473389 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.473560 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.473689 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.473857 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.473999 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.474161 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.474289 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.474467 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.474595 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.474764 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.474959 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.475165 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.475326 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.475578 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.475709 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.475835 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.476029 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.476160 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.476286 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.476411 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.476536 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.476681 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.476820 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.476947 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.477069 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.477202 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.477336 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.477472 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.477599 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.477750 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.477881 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.478053 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.478189 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.478365 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.478499 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.478669 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.478799 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.478969 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.479097 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.479271 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.479400 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.479571 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.479699 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.479871 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.480032 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.480198 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.480328 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.480513 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.480651 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.480816 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.480957 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.481122 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.481251 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.481423 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.481562 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.481720 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.481924 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.482054 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.482189 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.482316 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.482442 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.482641 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.482865 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.483004 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.483191 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.483320 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.483500 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.483638 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.483812 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.483943 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.484151 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.484282 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.484459 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.484600 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.484779 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.484916 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.485089 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.485217 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.485400 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.485539 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.485702 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.485845 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.486003 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.486131 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.486302 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.486431 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.486602 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.486733 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.486907 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.487166 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.487304 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.487490 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.487628 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.487788 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.487926 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.488117 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.488248 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.488414 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.488545 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.488712 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.488842 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.489008 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.489137 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.489303 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.489447 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.489608 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.489746 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.489905 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.490045 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.490209 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.490348 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.491063 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.491317 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.491446 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.491572 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.491699 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.491834 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.492011 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.492153 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.492281 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.492434 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.492566 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.492740 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.492871 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.493052 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.493183 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.493357 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.493487 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.493662 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.493792 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.493964 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.494102 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.494268 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.494407 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.494581 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.494711 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.494886 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.495016 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.495196 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.495334 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.495499 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.495632 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.495821 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.495949 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.496151 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.496292 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.496452 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.496581 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.496745 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.496873 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.497045 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.497183 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.497345 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.497474 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.497647 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.497786 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.497948 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.498079 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.498242 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.498373 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.498543 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.498674 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.498838 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.498969 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.499143 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.499272 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.499443 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.499572 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.499738 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.499878 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.500065 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.500195 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.500348 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.500488 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.500650 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.500784 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.500946 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.501084 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.501249 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.501388 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.501543 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.501673 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.501850 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.501984 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.502146 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.502284 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.502443 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.502574 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.502741 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.502870 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.503044 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.503182 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.503343 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.503471 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.503636 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.503755 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.503947 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.504108 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.504271 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.504408 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.504567 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.504695 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.504868 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.504991 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.505171 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.505301 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.505466 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.505595 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.505798 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.505927 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.506075 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.506854 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.507033 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.507183 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.507321 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.507450 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.507576 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.507702 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.507828 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.507995 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.508126 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.508266 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.508394 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.508527 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.508653 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.508788 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.508916 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.509042 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.509194 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.509334 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.509488 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.509627 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.509768 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.509895 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.510066 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.510204 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.510363 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.510502 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.510930 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.511062 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.511233 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.511368 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.511528 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.511668 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.511825 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.511994 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.512136 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.512264 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.512468 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.512600 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.512764 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.512893 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.513071 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.513199 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.513372 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.513504 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.513679 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.513808 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.513980 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.514118 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.514283 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.514419 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.514554 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.514681 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.514853 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.514983 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.515147 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.515276 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.515452 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.515582 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.515753 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.515891 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.516058 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.516199 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.516366 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.516502 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.516661 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.516805 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.516973 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.517104 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.517276 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.517407 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.517579 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.517720 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.517890 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.518020 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.518204 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.518334 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.518517 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.518656 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.518813 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.518941 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.519112 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.519255 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.519414 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.519552 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.519714 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.519844 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.520017 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.520145 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.520326 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.520466 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.520627 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.520757 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.520929 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.521059 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.521227 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.521364 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.521528 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.521658 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.521860 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.521994 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.522172 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.522383 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.522513 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.522699 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.522829 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.523008 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.523140 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.523309 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.523447 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.523629 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.523761 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.523937 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.524104 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.524260 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.524390 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.524566 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.524697 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.524870 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.525001 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.525174 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.525302 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.525472 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.525601 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.525776 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.525914 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.526083 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.526213 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.526391 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.526530 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.526695 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.526825 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.527002 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.527132 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.527310 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.527453 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.527613 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.527741 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.527919 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.528118 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.528247 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.528387 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.528523 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.528638 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.528833 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.528963 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.529135 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.529275 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.529442 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.529571 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.529742 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.529872 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.530061 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.530191 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.530363 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.530500 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.530676 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.530806 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.530971 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.531103 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.531268 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.531407 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.531564 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.531694 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.531877 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.532043 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.532197 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.532329 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.532512 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.532641 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.532918 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.533053 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.533219 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.533360 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.533517 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.533656 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.533848 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.533976 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.534230 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.534371 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.534500 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.534699 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.534837 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.534964 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.535089 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.535231 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.535347 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.535482 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.535609 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.535735 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.535909 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.536075 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.536253 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.536397 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.536556 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.536693 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.536876 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.537006 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.537197 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.537855 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.538158 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.538287 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.538514 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.538666 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.538836 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.539047 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.539187 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.539361 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.539491 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.539677 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.539809 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.540021 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.540170 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.540350 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.540489 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.540675 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.540807 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.540981 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.541122 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.541295 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.541426 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.541611 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.541741 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.541933 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.542083 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.542248 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.542369 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.542546 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.542686 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.542846 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.542977 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.543148 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.543277 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.543447 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.543576 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.543751 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.543883 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.544093 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.544223 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.544396 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.544524 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.544694 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.544834 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.544991 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.545129 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.545308 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.545430 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.545635 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.545765 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.545891 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.546019 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.546197 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.546338 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.546511 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.546641 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.546827 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.546965 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.547125 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.547265 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.547439 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.547568 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.547741 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.547873 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.548062 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.548208 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.548361 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.548492 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.548656 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.548787 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.548990 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.549135 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.549270 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.549397 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.549578 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.549707 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.549897 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.550026 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.550198 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.550327 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.550506 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.550643 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.550817 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.550956 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.551149 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.551281 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.551407 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.551533 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.551721 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.551859 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.552052 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.552191 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.552347 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.552469 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.552646 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.552777 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.553016 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.553222 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.553388 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.553528 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.553656 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.553817 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.553947 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.554127 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.554257 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.554450 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.554622 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.554782 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.554913 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.555108 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.555238 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.555420 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.555551 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.555753 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.555884 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.556102 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.556233 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.556406 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.556538 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.556704 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.556842 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.557002 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.557138 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.557299 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.557428 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.557607 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.557737 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.557916 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.558054 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.558219 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.558358 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.558562 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.558700 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.558843 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.559017 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.559130 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.559296 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.559421 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.559599 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.559717 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.559903 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.560044 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.560232 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.560348 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.560616 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.560744 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.560925 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.561048 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.561228 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.561351 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.561537 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.561663 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.561837 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.561951 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.562141 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.562257 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.562444 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.562654 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.562773 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.562977 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.563101 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.563287 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.563402 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.563593 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.563710 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.563898 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.564044 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.564228 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.564362 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.564535 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.564676 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.564840 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.564971 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.565146 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.565285 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.565457 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.565597 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.565762 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.565894 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.566083 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.566222 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.566399 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.566528 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.566717 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.566846 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.567033 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.567163 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.567343 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.567473 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.567654 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.567866 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.568106 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.568238 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.568375 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.569042 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.569199 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.569450 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.569689 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.569828 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.570043 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.570158 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.570349 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.570491 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.570656 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.570787 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.570960 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.571091 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.571264 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.571404 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.571571 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.571701 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.571880 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.572055 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.572210 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.572355 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.572514 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.572654 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.572822 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.572960 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.573131 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.573271 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.573447 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.573578 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.573773 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.573904 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.574091 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.574247 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.574398 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.574543 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.574706 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.574906 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.575063 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.575223 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.575513 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.575591 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.575833 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.575947 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.576186 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.576265 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.576508 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.576586 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.576827 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.576924 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.577138 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.577216 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.577452 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.577530 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.577763 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.577849 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.578063 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.578139 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.578364 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.578441 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.578671 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.578757 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.578974 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.579052 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.579272 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.579351 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.579591 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.579670 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.579899 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.579997 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.580241 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.580318 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.580556 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.580634 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.580863 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.580949 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.581380 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.581481 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.581696 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.581787 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.582022 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.582099 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.582341 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.582429 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.582660 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.582878 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.582967 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.583258 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.583346 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.583575 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.583655 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.583877 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.584069 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.584262 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.584881 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.585073 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.585213 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.585381 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.585537 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.585665 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.585823 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.585953 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.586107 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.586238 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.586434 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.586564 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.586747 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.586880 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.587054 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.587184 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.587376 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.587507 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.587688 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.587819 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.588016 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.588256 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.588387 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.588604 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.588753 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.588908 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.589046 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.589209 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.589349 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.589507 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.589638 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.589805 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.589934 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.590102 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.590234 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.590408 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.590547 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.590705 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.590835 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.591008 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.591138 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.591307 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.591438 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.591612 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.591743 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.591909 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.592059 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.592238 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.592373 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.592537 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.592666 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.592851 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.592988 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.593152 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.593281 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.593460 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.593588 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.593764 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.593904 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.594087 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.594218 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.594389 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.594517 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.594693 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.594834 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.594995 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.595109 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.595302 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.595431 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.595605 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.595744 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.595907 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.596164 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.596297 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.596493 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.596636 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.596809 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.596939 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.597109 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.597238 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.597418 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.597557 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.597722 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.597860 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.598021 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.598150 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.598320 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.598459 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.598628 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.598758 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.598930 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.599060 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.599234 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.599372 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.599539 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.599670 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.599889 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.600141 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.600329 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.600459 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.600588 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.600723 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.600851 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.600977 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.601154 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.601286 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.601464 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.601595 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.601807 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.601937 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.602127 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.602258 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.602429 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.602661 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.602794 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.602996 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.603128 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.603317 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.603451 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.603650 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.603781 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.604008 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.604142 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.604282 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.604418 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.604590 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.604721 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.604927 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.605057 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.605172 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.605295 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.605476 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.605614 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.605786 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.605924 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.606090 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.606229 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.606397 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.606540 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.606712 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.606844 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.607018 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.607147 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.607318 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.607457 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.607625 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.607754 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.607933 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.608097 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.608264 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.608407 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.608572 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.608703 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.608880 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.609011 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.609190 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.609322 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.609498 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.609628 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.609810 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.609943 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.610131 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.610260 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.610437 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.610568 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.610754 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.610885 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.611073 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.611196 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.611389 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.611519 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.611698 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.611842 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.612039 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.612181 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.612316 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.612443 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.612569 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.612704 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.612872 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.613009 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.613181 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.613312 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.613481 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.613620 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.613777 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.613917 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.614072 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.614244 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.614418 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.614553 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.614679 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.614862 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.614994 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.615183 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.615323 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.615531 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.615675 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.615857 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.616026 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.616224 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.616363 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.616522 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.616681 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.616811 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.617004 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.617143 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.617316 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.617447 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.617644 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.617774 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.617953 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.618092 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.618249 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.618380 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.618546 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.618676 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.618845 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.618983 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.619142 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.619279 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.619437 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.619575 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.619761 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.619905 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.620102 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.620244 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.620410 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.620540 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.620712 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.620843 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.621014 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.621143 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.621321 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.621450 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.621622 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.621752 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.621927 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.622055 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.622231 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.622361 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.622534 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.622666 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.622832 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.622961 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.623130 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.623266 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.623431 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.623564 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.623731 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.623868 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.624054 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.624200 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.624356 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.624495 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.624657 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.624788 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.624958 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.625100 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.625258 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.625386 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.625560 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.625692 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.625862 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.626001 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.626163 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.626300 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.626463 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.626593 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.626774 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.626913 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.627083 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.627213 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.627388 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.627519 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.627710 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.627842 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.628025 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.628155 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.628330 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.628460 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.628632 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.628764 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.628935 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.629066 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.629238 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.629369 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.629546 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.629677 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.629850 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.629981 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.630153 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.630293 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.630464 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.630594 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.630773 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.630903 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.631678 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.632064 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.632182 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.632311 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.632449 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.632576 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.632703 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.632838 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.632966 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.633093 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.633265 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.633407 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.633610 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.633740 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.633893 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.634033 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.634218 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.634350 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.634529 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.634668 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.634835 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.634967 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.635134 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.635272 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.635398 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 11:24:18.635508 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.636044 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.636361 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.636672 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.636984 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.637293 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.637609 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.637921 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.638233 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.638547 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.638864 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.639191 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.639516 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.639827 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.640177 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.640507 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.640853 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.641164 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.641508 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.641834 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.642148 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.642466 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.642770 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:24:18.643013 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 11:24:18.788854 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: INFO dbcounter [None req-63f2cabd-47d3-4eb6-a970-aa3fd94c004e None None] Registered counter for database nova_api Aug 10 11:24:18.798140 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: INFO dbcounter [None req-5cd4309f-5c3f-40d9-b0f6-54ad5c225821 None None] Registered counter for database nova_api Aug 10 11:24:18.808281 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG oslo_db.sqlalchemy.engines [None req-63f2cabd-47d3-4eb6-a970-aa3fd94c004e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103523) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 11:24:18.814639 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG dbcounter [-] [103523] Writer thread running {{(pid=103523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 11:24:18.819350 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG oslo_db.sqlalchemy.engines [None req-5cd4309f-5c3f-40d9-b0f6-54ad5c225821 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103524) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 11:24:18.825937 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG dbcounter [-] [103524] Writer thread running {{(pid=103524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 11:24:18.870304 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.context [None req-63f2cabd-47d3-4eb6-a970-aa3fd94c004e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),57932da1-fc7c-42ec-b0c9-ecc094a8eac1(cell1) {{(pid=103523) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 11:24:18.874143 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-63f2cabd-47d3-4eb6-a970-aa3fd94c004e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:18.874610 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-63f2cabd-47d3-4eb6-a970-aa3fd94c004e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:18.876187 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-63f2cabd-47d3-4eb6-a970-aa3fd94c004e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:18.876901 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-63f2cabd-47d3-4eb6-a970-aa3fd94c004e None None] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:18.877343 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-63f2cabd-47d3-4eb6-a970-aa3fd94c004e None None] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:18.879298 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-63f2cabd-47d3-4eb6-a970-aa3fd94c004e None None] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:18.881830 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: INFO dbcounter [None req-63f2cabd-47d3-4eb6-a970-aa3fd94c004e None None] Registered counter for database nova_cell0 Aug 10 11:24:18.882217 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.context [None req-5cd4309f-5c3f-40d9-b0f6-54ad5c225821 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),57932da1-fc7c-42ec-b0c9-ecc094a8eac1(cell1) {{(pid=103524) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 11:24:18.886318 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG oslo_concurrency.lockutils [None req-5cd4309f-5c3f-40d9-b0f6-54ad5c225821 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:18.886813 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG oslo_concurrency.lockutils [None req-5cd4309f-5c3f-40d9-b0f6-54ad5c225821 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:18.887424 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: INFO dbcounter [None req-63f2cabd-47d3-4eb6-a970-aa3fd94c004e None None] Registered counter for database nova_cell1 Aug 10 11:24:18.888416 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG oslo_concurrency.lockutils [None req-5cd4309f-5c3f-40d9-b0f6-54ad5c225821 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:18.889147 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG oslo_concurrency.lockutils [None req-5cd4309f-5c3f-40d9-b0f6-54ad5c225821 None None] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:18.889608 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG oslo_concurrency.lockutils [None req-5cd4309f-5c3f-40d9-b0f6-54ad5c225821 None None] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:18.891594 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG oslo_concurrency.lockutils [None req-5cd4309f-5c3f-40d9-b0f6-54ad5c225821 None None] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:18.893645 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: INFO dbcounter [None req-5cd4309f-5c3f-40d9-b0f6-54ad5c225821 None None] Registered counter for database nova_cell0 Aug 10 11:24:18.894569 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG oslo_db.sqlalchemy.engines [None req-63f2cabd-47d3-4eb6-a970-aa3fd94c004e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103523) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 11:24:18.897739 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG oslo_db.sqlalchemy.engines [None req-63f2cabd-47d3-4eb6-a970-aa3fd94c004e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103523) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 11:24:18.900044 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: INFO dbcounter [None req-5cd4309f-5c3f-40d9-b0f6-54ad5c225821 None None] Registered counter for database nova_cell1 Aug 10 11:24:18.901976 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG dbcounter [-] [103523] Writer thread running {{(pid=103523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 11:24:18.907343 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG oslo_db.sqlalchemy.engines [None req-5cd4309f-5c3f-40d9-b0f6-54ad5c225821 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103524) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 11:24:18.909145 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG oslo_db.sqlalchemy.engines [None req-5cd4309f-5c3f-40d9-b0f6-54ad5c225821 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103524) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 11:24:18.916609 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG dbcounter [-] [103524] Writer thread running {{(pid=103524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 11:24:18.916961 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG dbcounter [-] [103524] Writer thread running {{(pid=103524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 11:24:19.036530 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG dbcounter [-] [103523] Writer thread running {{(pid=103523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 11:24:19.046670 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: INFO dbcounter [None req-63f2cabd-47d3-4eb6-a970-aa3fd94c004e None None] Registered counter for database nova_cell0 Aug 10 11:24:19.054284 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG oslo_db.sqlalchemy.engines [None req-63f2cabd-47d3-4eb6-a970-aa3fd94c004e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103523) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 11:24:19.058611 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG dbcounter [-] [103523] Writer thread running {{(pid=103523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 11:24:19.065769 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: INFO dbcounter [None req-5cd4309f-5c3f-40d9-b0f6-54ad5c225821 None None] Registered counter for database nova_cell0 Aug 10 11:24:19.072974 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG oslo_db.sqlalchemy.engines [None req-5cd4309f-5c3f-40d9-b0f6-54ad5c225821 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103524) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 11:24:19.077336 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG dbcounter [-] [103524] Writer thread running {{(pid=103524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 11:24:19.477337 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: WARNING keystonemiddleware.auth_token [None req-63f2cabd-47d3-4eb6-a970-aa3fd94c004e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 11:24:19.484575 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: WARNING keystonemiddleware.auth_token [None req-63f2cabd-47d3-4eb6-a970-aa3fd94c004e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 11:24:19.501945 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: WARNING keystonemiddleware.auth_token [None req-5cd4309f-5c3f-40d9-b0f6-54ad5c225821 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 11:24:19.509915 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: WARNING keystonemiddleware.auth_token [None req-5cd4309f-5c3f-40d9-b0f6-54ad5c225821 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 11:24:19.826554 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: WARNING keystonemiddleware.auth_token [None req-63f2cabd-47d3-4eb6-a970-aa3fd94c004e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 11:24:19.832463 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: WARNING keystonemiddleware.auth_token [None req-63f2cabd-47d3-4eb6-a970-aa3fd94c004e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 11:24:19.838272 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d13f89f9c0 pid: 103523 (default app) Aug 10 11:24:19.840376 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-63f2cabd-47d3-4eb6-a970-aa3fd94c004e None None] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:19.841549 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-63f2cabd-47d3-4eb6-a970-aa3fd94c004e None None] 10.222.0.62 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001760 Aug 10 11:24:19.841960 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 1/1] 10.222.0.62 () {50 vars in 788 bytes} [Wed Aug 10 11:24:19 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:24:19.850611 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: WARNING keystonemiddleware.auth_token [None req-5cd4309f-5c3f-40d9-b0f6-54ad5c225821 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 11:24:19.856564 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: WARNING keystonemiddleware.auth_token [None req-5cd4309f-5c3f-40d9-b0f6-54ad5c225821 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 11:24:19.861785 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d13f89f9c0 pid: 103524 (default app) Aug 10 11:25:38.568346 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-63f2cabd-47d3-4eb6-a970-aa3fd94c004e None None] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:38.569339 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-63f2cabd-47d3-4eb6-a970-aa3fd94c004e None None] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Aug 10 11:25:38.569994 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 2/2] 10.222.0.62 () {54 vars in 931 bytes} [Wed Aug 10 11:25:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:25:38.582070 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG dbcounter [-] [103524] Writing DB stats nova_api:SELECT=3 {{(pid=103524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:38.583226 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG dbcounter [-] [103524] Writing DB stats nova_cell0:SELECT=3 {{(pid=103524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:38.584417 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG dbcounter [-] [103524] Writing DB stats nova_cell1:SELECT=3 {{(pid=103524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:38.585637 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG dbcounter [-] [103524] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:39.470217 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-4310de67-6b83-40b7-b056-993a1fddfd5e admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:39.503677 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-4310de67-6b83-40b7-b056-993a1fddfd5e admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.926656 Aug 10 11:25:39.505244 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 1/3] 10.222.0.62 () {60 vars in 1292 bytes} [Wed Aug 10 11:25:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:41.736030 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-63f2cabd-47d3-4eb6-a970-aa3fd94c004e None None] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:41.737207 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-63f2cabd-47d3-4eb6-a970-aa3fd94c004e None None] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 Aug 10 11:25:41.737609 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 3/4] 10.222.0.62 () {54 vars in 931 bytes} [Wed Aug 10 11:25:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:25:42.195294 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-a7a16a91-c658-4ea5-aeb9-3b615047074d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "name": "cirros256", "ram": 256, "rxtx_factor": 1.0, "disk": 1, "id": "c1"}} {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:25:42.216687 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 11:25:42.216687 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: warnings.warn(msg) Aug 10 11:25:42.303168 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-a7a16a91-c658-4ea5-aeb9-3b615047074d admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.556462 Aug 10 11:25:42.311025 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 2/5] 10.222.0.62 () {64 vars in 1283 bytes} [Wed Aug 10 11:25:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 11:25:42.518409 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-8a6e64ee-3d56-4092-af6f-0acd5e0b85f3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:25:42.522772 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 11:25:42.522772 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: warnings.warn(msg) Aug 10 11:25:42.525459 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG dbcounter [-] [103523] Writing DB stats nova_api:SELECT=3 {{(pid=103523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:42.526251 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG dbcounter [-] [103523] Writing DB stats nova_cell0:SELECT=3 {{(pid=103523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:42.527196 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG dbcounter [-] [103523] Writing DB stats nova_cell1:SELECT=3 {{(pid=103523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:42.527831 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG dbcounter [-] [103523] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:42.673710 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-8a6e64ee-3d56-4092-af6f-0acd5e0b85f3 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.361351 Aug 10 11:25:42.674538 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 4/6] 10.222.0.62 () {64 vars in 1336 bytes} [Wed Aug 10 11:25:42 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:44.937350 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-a7a16a91-c658-4ea5-aeb9-3b615047074d admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:44.940299 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-a7a16a91-c658-4ea5-aeb9-3b615047074d admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003378 Aug 10 11:25:44.940922 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 3/7] 10.222.0.62 () {54 vars in 931 bytes} [Wed Aug 10 11:25:44 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:25:45.645609 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-0e1962ec-6086-4a1f-bdc3-a8bababd77ff admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "vcpus": 1, "ram": 512, "swap": 0, "rxtx_factor": 1.0, "disk": 5, "os-flavor-access:is_public": true, "name": "ds512M"}} {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:25:45.665366 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 11:25:45.665366 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: warnings.warn(msg) Aug 10 11:25:45.785150 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-0e1962ec-6086-4a1f-bdc3-a8bababd77ff admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.837706 Aug 10 11:25:45.785787 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 5/8] 10.222.0.62 () {64 vars in 1283 bytes} [Wed Aug 10 11:25:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 11:25:45.797842 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-7d3ba1e9-bab8-4cad-9a4f-57b74374740c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:25:45.800916 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 11:25:45.800916 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: warnings.warn(msg) Aug 10 11:25:45.908339 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-7d3ba1e9-bab8-4cad-9a4f-57b74374740c admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113923 Aug 10 11:25:45.909415 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 4/9] 10.222.0.62 () {64 vars in 1336 bytes} [Wed Aug 10 11:25:45 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:48.146262 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-0e1962ec-6086-4a1f-bdc3-a8bababd77ff admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:48.147299 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-0e1962ec-6086-4a1f-bdc3-a8bababd77ff admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 10 11:25:48.147698 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 6/10] 10.222.0.62 () {54 vars in 931 bytes} [Wed Aug 10 11:25:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:25:48.545167 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-9e41a145-8eac-480d-be89-dd8a151d378f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "d2", "os-flavor-access:is_public": true, "name": "ds1G", "disk": 10, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0}} {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:25:48.623458 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-9e41a145-8eac-480d-be89-dd8a151d378f admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.469709 Aug 10 11:25:48.623934 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 5/11] 10.222.0.62 () {64 vars in 1283 bytes} [Wed Aug 10 11:25:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 11:25:48.637003 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-20e61f64-e982-4c96-920d-7ead0638bd0a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:25:48.712767 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-20e61f64-e982-4c96-920d-7ead0638bd0a admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079772 Aug 10 11:25:48.713348 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 7/12] 10.222.0.62 () {64 vars in 1336 bytes} [Wed Aug 10 11:25:48 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:50.920999 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-9e41a145-8eac-480d-be89-dd8a151d378f admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:50.922116 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-9e41a145-8eac-480d-be89-dd8a151d378f admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Aug 10 11:25:50.922617 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 6/13] 10.222.0.62 () {54 vars in 931 bytes} [Wed Aug 10 11:25:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:25:51.391561 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-9a5735c3-4180-4de4-9f50-f6e727ff0944 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 10, "vcpus": 2, "name": "ds2G"}} {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:25:51.461942 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-9a5735c3-4180-4de4-9f50-f6e727ff0944 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.532553 Aug 10 11:25:51.462610 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 8/14] 10.222.0.62 () {64 vars in 1283 bytes} [Wed Aug 10 11:25:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:25:51.475227 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-7e31c617-da9b-4254-9a01-0f6d2a73cbbe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:25:51.562550 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-7e31c617-da9b-4254-9a01-0f6d2a73cbbe admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091591 Aug 10 11:25:51.564499 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 7/15] 10.222.0.62 () {64 vars in 1336 bytes} [Wed Aug 10 11:25:51 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:53.783404 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-9a5735c3-4180-4de4-9f50-f6e727ff0944 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:53.783868 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-9a5735c3-4180-4de4-9f50-f6e727ff0944 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Aug 10 11:25:53.790112 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 9/16] 10.222.0.62 () {54 vars in 931 bytes} [Wed Aug 10 11:25:53 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:25:54.222834 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-65a09fe6-0a39-4176-b778-46ba441294d8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 4, "name": "ds4G", "swap": 0, "ram": 4096, "id": "d4"}} {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:25:54.307973 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-65a09fe6-0a39-4176-b778-46ba441294d8 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.516556 Aug 10 11:25:54.316380 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 8/17] 10.222.0.62 () {64 vars in 1283 bytes} [Wed Aug 10 11:25:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 11:25:54.321460 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-c3b6476c-9276-4d97-ac68-5d9690b6bf43 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:25:54.432606 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-c3b6476c-9276-4d97-ac68-5d9690b6bf43 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114999 Aug 10 11:25:54.433383 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 10/18] 10.222.0.62 () {64 vars in 1336 bytes} [Wed Aug 10 11:25:54 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:56.876532 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-65a09fe6-0a39-4176-b778-46ba441294d8 admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:56.877561 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-65a09fe6-0a39-4176-b778-46ba441294d8 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Aug 10 11:25:56.877995 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 9/19] 10.222.0.62 () {54 vars in 931 bytes} [Wed Aug 10 11:25:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:25:57.329054 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-b572e112-f32e-4c34-86cd-775d06dfc94a admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:57.354601 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-b572e112-f32e-4c34-86cd-775d06dfc94a admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.470025 Aug 10 11:25:57.355155 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 11/20] 10.222.0.62 () {60 vars in 1292 bytes} [Wed Aug 10 11:25:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:25:59.704300 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-65a09fe6-0a39-4176-b778-46ba441294d8 admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:59.705322 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-65a09fe6-0a39-4176-b778-46ba441294d8 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Aug 10 11:25:59.705727 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 10/21] 10.222.0.62 () {54 vars in 931 bytes} [Wed Aug 10 11:25:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:26:00.177847 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-4975f724-2af0-40c4-ad9e-13a370b5d6f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "id": "1", "disk": 1, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:26:00.252312 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-4975f724-2af0-40c4-ad9e-13a370b5d6f4 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.539352 Aug 10 11:26:00.253056 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 12/22] 10.222.0.62 () {64 vars in 1283 bytes} [Wed Aug 10 11:25:59 2022] POST /compute/v2.1/flavors => generated 402 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:26:00.265467 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-deac1ab0-3ea9-42b2-9ab1-61858a72fe8d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:26:00.348286 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-deac1ab0-3ea9-42b2-9ab1-61858a72fe8d admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086631 Aug 10 11:26:00.351700 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 11/23] 10.222.0.62 () {64 vars in 1333 bytes} [Wed Aug 10 11:26:00 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:26:02.589353 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-4975f724-2af0-40c4-ad9e-13a370b5d6f4 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:02.590363 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-4975f724-2af0-40c4-ad9e-13a370b5d6f4 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Aug 10 11:26:02.590765 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 13/24] 10.222.0.62 () {54 vars in 931 bytes} [Wed Aug 10 11:26:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:26:02.996160 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-f8a50c21-999f-4b4b-badd-963e48be894d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "ram": 2048, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "name": "m1.small"}} {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:26:03.069304 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-f8a50c21-999f-4b4b-badd-963e48be894d admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.472538 Aug 10 11:26:03.069783 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 12/25] 10.222.0.62 () {64 vars in 1283 bytes} [Wed Aug 10 11:26:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:26:03.082610 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-53666792-4767-4196-a49c-f567d0f3f85f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:26:03.162536 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-53666792-4767-4196-a49c-f567d0f3f85f admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084384 Aug 10 11:26:03.163102 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 14/26] 10.222.0.62 () {64 vars in 1333 bytes} [Wed Aug 10 11:26:03 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:05.411731 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-f8a50c21-999f-4b4b-badd-963e48be894d admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:05.412826 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-f8a50c21-999f-4b4b-badd-963e48be894d admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Aug 10 11:26:05.413229 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 13/27] 10.222.0.62 () {54 vars in 931 bytes} [Wed Aug 10 11:26:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:26:05.781647 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-cb89d54d-3615-404e-992e-f147ac7f70a7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "swap": 0, "id": "3", "vcpus": 2, "disk": 40, "name": "m1.medium", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:26:05.857576 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-cb89d54d-3615-404e-992e-f147ac7f70a7 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.438343 Aug 10 11:26:05.858135 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 15/28] 10.222.0.62 () {64 vars in 1283 bytes} [Wed Aug 10 11:26:05 2022] POST /compute/v2.1/flavors => generated 406 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:26:05.870880 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-b166fdfc-e3f4-4d21-919b-dd5f5b19a87b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:26:05.970293 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-b166fdfc-e3f4-4d21-919b-dd5f5b19a87b admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102911 Aug 10 11:26:05.970876 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 14/29] 10.222.0.62 () {64 vars in 1333 bytes} [Wed Aug 10 11:26:05 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:08.228327 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-cb89d54d-3615-404e-992e-f147ac7f70a7 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:08.229960 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-cb89d54d-3615-404e-992e-f147ac7f70a7 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002119 Aug 10 11:26:08.230565 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 16/30] 10.222.0.62 () {54 vars in 931 bytes} [Wed Aug 10 11:26:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:26:08.692505 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-fd621e0d-68c5-4f09-9678-93637a4aab8d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 8192, "id": "4", "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "vcpus": 4, "name": "m1.large"}} {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:26:08.698689 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG dbcounter [-] [103524] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:26:08.764593 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-fd621e0d-68c5-4f09-9678-93637a4aab8d admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.527744 Aug 10 11:26:08.765149 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 15/31] 10.222.0.62 () {64 vars in 1283 bytes} [Wed Aug 10 11:26:08 2022] POST /compute/v2.1/flavors => generated 405 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:26:08.779304 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-bd2c812e-a5fe-44e6-8308-6bca0c187bae admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:26:08.854642 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-bd2c812e-a5fe-44e6-8308-6bca0c187bae admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080399 Aug 10 11:26:08.855326 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 17/32] 10.222.0.62 () {64 vars in 1333 bytes} [Wed Aug 10 11:26:08 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:26:11.127835 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-fd621e0d-68c5-4f09-9678-93637a4aab8d admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:11.129083 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-fd621e0d-68c5-4f09-9678-93637a4aab8d admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002183 Aug 10 11:26:11.129485 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 16/33] 10.222.0.62 () {54 vars in 931 bytes} [Wed Aug 10 11:26:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:26:11.583490 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-db4f36a6-15c5-4155-8253-62ec1389c193 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "vcpus": 8, "name": "m1.xlarge", "os-flavor-access:is_public": true, "id": "5", "swap": 0}} {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:26:11.673087 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-db4f36a6-15c5-4155-8253-62ec1389c193 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.537660 Aug 10 11:26:11.674329 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 18/34] 10.222.0.62 () {64 vars in 1283 bytes} [Wed Aug 10 11:26:11 2022] POST /compute/v2.1/flavors => generated 408 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:26:11.689974 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-38e58e49-a59b-40ed-a102-c9dec2a53b89 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:26:11.788860 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-38e58e49-a59b-40ed-a102-c9dec2a53b89 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.106192 Aug 10 11:26:11.789513 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 17/35] 10.222.0.62 () {64 vars in 1333 bytes} [Wed Aug 10 11:26:11 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:32.703325 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-db4f36a6-15c5-4155-8253-62ec1389c193 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:32.704420 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-db4f36a6-15c5-4155-8253-62ec1389c193 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 Aug 10 11:26:32.705080 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 19/36] 10.222.0.62 () {54 vars in 931 bytes} [Wed Aug 10 11:26:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:26:33.091149 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-d62c0948-9aef-4f8a-838b-fbe8f5dc1824 admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:33.109014 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-d62c0948-9aef-4f8a-838b-fbe8f5dc1824 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.397853 Aug 10 11:26:33.109540 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 18/37] 10.222.0.62 () {60 vars in 1292 bytes} [Wed Aug 10 11:26:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:26:34.191637 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-db4f36a6-15c5-4155-8253-62ec1389c193 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:34.192667 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-db4f36a6-15c5-4155-8253-62ec1389c193 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 10 11:26:34.193060 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 20/38] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Aug 10 11:26:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:26:34.713330 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-25e83fcb-0a62-49c1-a890-52bae6a473f9 admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:34.719043 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.wsgi [None req-25e83fcb-0a62-49c1-a890-52bae6a473f9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 10 11:26:34.722529 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-25e83fcb-0a62-49c1-a890-52bae6a473f9 admin admin] Request method failure captured: Aug 10 11:26:34.722529 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 10 11:26:34.722529 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: Accept: application/json Aug 10 11:26:34.722529 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: Accept-Encoding: gzip, deflate Aug 10 11:26:34.722529 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: Connection: keep-alive Aug 10 11:26:34.722529 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: Content-Length: 0 Aug 10 11:26:34.722529 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: Host: 10.222.0.62 Aug 10 11:26:34.722529 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: Openstack-Api-Version: compute 2.90 Aug 10 11:26:34.722529 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: Openstack-System-Scope: None Aug 10 11:26:34.722529 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: User-Agent: python-novaclient Aug 10 11:26:34.722529 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-Auth-Token: gAAAAABi85XqqPJaoI-XF1fdAZq9Wb7a3sojGnv9yyzYSPfl_0u4oSko2r7dSemRYDVT6ubH9zFxrG2F3EcKDOh3xLueoVacdyE7u_8b8V2vnPrNqfQkvpL335t-SgM91-XrwyA0JqkcA6OAUwYhtASpEclEtOhBl3p5F8Eq44TbH3lnMeHCNgA Aug 10 11:26:34.722529 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-Domain-Id: None Aug 10 11:26:34.722529 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-Domain-Name: None Aug 10 11:26:34.722529 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-Identity-Status: Confirmed Aug 10 11:26:34.722529 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-Is-Admin-Project: True Aug 10 11:26:34.722529 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 11:26:34.722529 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-Project-Domain-Id: default Aug 10 11:26:34.722529 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-Project-Domain-Name: Default Aug 10 11:26:34.722529 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-Project-Id: a09e756d78584d0e8f8d4c39716e435d Aug 10 11:26:34.722529 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-Project-Name: admin Aug 10 11:26:34.722529 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-Role: member,admin,reader Aug 10 11:26:34.722529 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-Roles: member,admin,reader Aug 10 11:26:34.724422 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/a09e756d78584d0e8f8d4c39716e435d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_a09e756d78584d0e8f8d4c39716e435d", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a09e756d78584d0e8f8d4c39716e435d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a09e756d78584d0e8f8d4c39716e435d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:26:34.724422 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-Tenant: admin Aug 10 11:26:34.724422 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-Tenant-Id: a09e756d78584d0e8f8d4c39716e435d Aug 10 11:26:34.724422 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-Tenant-Name: admin Aug 10 11:26:34.724422 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-User: admin Aug 10 11:26:34.724422 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-User-Domain-Id: default Aug 10 11:26:34.724422 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-User-Domain-Name: Default Aug 10 11:26:34.724422 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-User-Id: 9099bf734514476a96c510cc6ad791bb Aug 10 11:26:34.724422 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-User-Name: admin Aug 10 11:26:34.724422 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: method: > Aug 10 11:26:34.724422 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: exception: Flavor 42 could not be found. Aug 10 11:26:34.724422 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: action_args: {'id': '42'} Aug 10 11:26:34.724422 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:26:34.724422 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:26:34.725599 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 11:26:34.725599 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 11:26:34.725599 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 11:26:34.725599 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 11:26:34.725599 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 11:26:34.725599 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 11:26:34.725599 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 11:26:34.725599 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 11:26:34.725599 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 11:26:34.725599 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:26:34.725599 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 11:26:34.725599 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 11:26:34.725599 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 10 11:26:34.725599 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Aug 10 11:26:34.725599 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:26:34.725599 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Aug 10 11:26:34.725599 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:26:34.725599 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:26:34.725599 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:26:34.727042 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:26:34.727042 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:26:34.727042 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:26:34.727042 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:26:34.727042 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 11:26:34.727042 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:26:34.727042 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 10 11:26:34.727042 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Aug 10 11:26:34.727042 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:26:34.727042 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Aug 10 11:26:34.727042 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:26:34.727042 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:26:34.727042 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:26:34.727042 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:26:34.727042 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:26:34.727042 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 10 11:26:34.727042 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Aug 10 11:26:34.727042 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-25e83fcb-0a62-49c1-a890-52bae6a473f9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:26:34.728457 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-25e83fcb-0a62-49c1-a890-52bae6a473f9 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.393025 Aug 10 11:26:34.728457 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 19/39] 10.222.0.62 () {60 vars in 1190 bytes} [Wed Aug 10 11:26:34 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 11:26:34.733733 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-ad914a38-ea63-4a1c-a439-d4b68dc9d626 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:34.738341 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG dbcounter [-] [103523] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:26:34.757705 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-ad914a38-ea63-4a1c-a439-d4b68dc9d626 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027539 Aug 10 11:26:34.758238 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 21/40] 10.222.0.62 () {60 vars in 1210 bytes} [Wed Aug 10 11:26:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:26:34.768522 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-4c637ec6-05ce-43a7-bfb8-204807df7cbd admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:34.791869 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-4c637ec6-05ce-43a7-bfb8-204807df7cbd admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027153 Aug 10 11:26:34.792432 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 20/41] 10.222.0.62 () {60 vars in 1210 bytes} [Wed Aug 10 11:26:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:26:34.803521 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-9ff2956a-358d-4ba3-a205-21c927dd2b89 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:34.809329 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.wsgi [None req-9ff2956a-358d-4ba3-a205-21c927dd2b89 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 10 11:26:34.812572 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-9ff2956a-358d-4ba3-a205-21c927dd2b89 admin admin] Request method failure captured: Aug 10 11:26:34.812572 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 10 11:26:34.812572 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: Accept: application/json Aug 10 11:26:34.812572 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: Accept-Encoding: gzip, deflate Aug 10 11:26:34.812572 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: Connection: keep-alive Aug 10 11:26:34.812572 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: Content-Length: 0 Aug 10 11:26:34.812572 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: Host: 10.222.0.62 Aug 10 11:26:34.812572 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: Openstack-Api-Version: compute 2.90 Aug 10 11:26:34.812572 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: Openstack-System-Scope: None Aug 10 11:26:34.812572 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: User-Agent: python-novaclient Aug 10 11:26:34.812572 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-Auth-Token: gAAAAABi85XqqPJaoI-XF1fdAZq9Wb7a3sojGnv9yyzYSPfl_0u4oSko2r7dSemRYDVT6ubH9zFxrG2F3EcKDOh3xLueoVacdyE7u_8b8V2vnPrNqfQkvpL335t-SgM91-XrwyA0JqkcA6OAUwYhtASpEclEtOhBl3p5F8Eq44TbH3lnMeHCNgA Aug 10 11:26:34.812572 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-Domain-Id: None Aug 10 11:26:34.812572 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-Domain-Name: None Aug 10 11:26:34.812572 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-Identity-Status: Confirmed Aug 10 11:26:34.812572 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-Is-Admin-Project: True Aug 10 11:26:34.812572 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 11:26:34.812572 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-Project-Domain-Id: default Aug 10 11:26:34.812572 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-Project-Domain-Name: Default Aug 10 11:26:34.812572 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-Project-Id: a09e756d78584d0e8f8d4c39716e435d Aug 10 11:26:34.812572 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-Project-Name: admin Aug 10 11:26:34.812572 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-Role: member,admin,reader Aug 10 11:26:34.812572 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-Roles: member,admin,reader Aug 10 11:26:34.816357 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/a09e756d78584d0e8f8d4c39716e435d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_a09e756d78584d0e8f8d4c39716e435d", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a09e756d78584d0e8f8d4c39716e435d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a09e756d78584d0e8f8d4c39716e435d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:26:34.816357 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-Tenant: admin Aug 10 11:26:34.816357 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-Tenant-Id: a09e756d78584d0e8f8d4c39716e435d Aug 10 11:26:34.816357 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-Tenant-Name: admin Aug 10 11:26:34.816357 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-User: admin Aug 10 11:26:34.816357 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-User-Domain-Id: default Aug 10 11:26:34.816357 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-User-Domain-Name: Default Aug 10 11:26:34.816357 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-User-Id: 9099bf734514476a96c510cc6ad791bb Aug 10 11:26:34.816357 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-User-Name: admin Aug 10 11:26:34.816357 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: method: > Aug 10 11:26:34.816357 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: exception: Flavor 42 could not be found. Aug 10 11:26:34.816357 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: action_args: {'id': '42'} Aug 10 11:26:34.816357 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:26:34.816357 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:26:34.817338 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 11:26:34.817338 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 11:26:34.817338 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 11:26:34.817338 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 11:26:34.817338 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 11:26:34.817338 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 11:26:34.817338 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 11:26:34.817338 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 11:26:34.817338 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 11:26:34.817338 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:26:34.817338 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 11:26:34.817338 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 11:26:34.817338 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 10 11:26:34.817338 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Aug 10 11:26:34.817338 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:26:34.817338 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Aug 10 11:26:34.817338 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:26:34.817338 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:26:34.817338 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:26:34.818664 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:26:34.818664 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:26:34.818664 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:26:34.818664 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:26:34.818664 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 11:26:34.818664 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:26:34.818664 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 10 11:26:34.818664 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Aug 10 11:26:34.818664 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:26:34.818664 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Aug 10 11:26:34.818664 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:26:34.818664 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:26:34.818664 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:26:34.818664 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:26:34.818664 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:26:34.818664 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 10 11:26:34.818664 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Aug 10 11:26:34.818664 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-9ff2956a-358d-4ba3-a205-21c927dd2b89 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:26:34.820139 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-9ff2956a-358d-4ba3-a205-21c927dd2b89 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015716 Aug 10 11:26:34.820139 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 22/42] 10.222.0.62 () {60 vars in 1190 bytes} [Wed Aug 10 11:26:34 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 11:26:35.782727 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-4c637ec6-05ce-43a7-bfb8-204807df7cbd admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:35.784463 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-4c637ec6-05ce-43a7-bfb8-204807df7cbd admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002160 Aug 10 11:26:35.784857 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 21/43] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Aug 10 11:26:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:26:36.323184 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-fad73b20-2b1c-4eb3-b228-8536334dd4ce admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:36.328668 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.wsgi [None req-fad73b20-2b1c-4eb3-b228-8536334dd4ce admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 10 11:26:36.330805 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-fad73b20-2b1c-4eb3-b228-8536334dd4ce admin admin] Request method failure captured: Aug 10 11:26:36.330805 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 10 11:26:36.330805 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: Accept: application/json Aug 10 11:26:36.330805 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: Accept-Encoding: gzip, deflate Aug 10 11:26:36.330805 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: Connection: keep-alive Aug 10 11:26:36.330805 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: Content-Length: 0 Aug 10 11:26:36.330805 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: Host: 10.222.0.62 Aug 10 11:26:36.330805 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: Openstack-Api-Version: compute 2.90 Aug 10 11:26:36.330805 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: Openstack-System-Scope: None Aug 10 11:26:36.330805 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: User-Agent: python-novaclient Aug 10 11:26:36.330805 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-Auth-Token: gAAAAABi85XrQqqp-9arOUXDAL-gqqjbUdWoZ-KCII2WLxSkxH30pkdq2bV8dbokawAMY8RClp8_9wNjgkdo0j66i59gRdRf60a4eMyNsfwTEgwdofnfBoajC5lwsk664ME-uqfb7TAiOu4LlpE_WQof2K1JPkXOCRDmC_U5p9urRcl354sf4cE Aug 10 11:26:36.330805 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-Domain-Id: None Aug 10 11:26:36.330805 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-Domain-Name: None Aug 10 11:26:36.330805 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-Identity-Status: Confirmed Aug 10 11:26:36.330805 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-Is-Admin-Project: True Aug 10 11:26:36.330805 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 11:26:36.330805 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-Project-Domain-Id: default Aug 10 11:26:36.330805 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-Project-Domain-Name: Default Aug 10 11:26:36.330805 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-Project-Id: a09e756d78584d0e8f8d4c39716e435d Aug 10 11:26:36.330805 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-Project-Name: admin Aug 10 11:26:36.330805 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-Role: member,admin,reader Aug 10 11:26:36.330805 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-Roles: member,admin,reader Aug 10 11:26:36.332383 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/a09e756d78584d0e8f8d4c39716e435d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_a09e756d78584d0e8f8d4c39716e435d", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a09e756d78584d0e8f8d4c39716e435d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a09e756d78584d0e8f8d4c39716e435d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:26:36.332383 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-Tenant: admin Aug 10 11:26:36.332383 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-Tenant-Id: a09e756d78584d0e8f8d4c39716e435d Aug 10 11:26:36.332383 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-Tenant-Name: admin Aug 10 11:26:36.332383 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-User: admin Aug 10 11:26:36.332383 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-User-Domain-Id: default Aug 10 11:26:36.332383 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-User-Domain-Name: Default Aug 10 11:26:36.332383 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-User-Id: 9099bf734514476a96c510cc6ad791bb Aug 10 11:26:36.332383 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-User-Name: admin Aug 10 11:26:36.332383 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: method: > Aug 10 11:26:36.332383 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: exception: Flavor 84 could not be found. Aug 10 11:26:36.332383 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: action_args: {'id': '84'} Aug 10 11:26:36.332383 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:26:36.332383 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:26:36.333383 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 11:26:36.333383 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 11:26:36.333383 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 11:26:36.333383 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 11:26:36.333383 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 11:26:36.333383 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 11:26:36.333383 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 11:26:36.333383 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 11:26:36.333383 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 11:26:36.333383 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:26:36.333383 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 11:26:36.333383 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 11:26:36.333383 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 10 11:26:36.333383 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Aug 10 11:26:36.333383 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:26:36.333383 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Aug 10 11:26:36.333383 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:26:36.333383 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:26:36.333383 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:26:36.334810 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:26:36.334810 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:26:36.334810 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:26:36.334810 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:26:36.334810 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 11:26:36.334810 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:26:36.334810 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 10 11:26:36.334810 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Aug 10 11:26:36.334810 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:26:36.334810 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Aug 10 11:26:36.334810 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:26:36.334810 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:26:36.334810 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:26:36.334810 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:26:36.334810 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:26:36.334810 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 10 11:26:36.334810 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Aug 10 11:26:36.334810 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-fad73b20-2b1c-4eb3-b228-8536334dd4ce admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:26:36.336188 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-fad73b20-2b1c-4eb3-b228-8536334dd4ce admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.398975 Aug 10 11:26:36.336188 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 23/44] 10.222.0.62 () {60 vars in 1190 bytes} [Wed Aug 10 11:26:35 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 11:26:36.342077 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-543548b8-5b9c-4ec2-8dbf-962dd166fa34 admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:36.357888 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-543548b8-5b9c-4ec2-8dbf-962dd166fa34 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019347 Aug 10 11:26:36.358418 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 22/45] 10.222.0.62 () {60 vars in 1210 bytes} [Wed Aug 10 11:26:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:26:36.368199 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-783913e9-b186-48db-88da-a9f8b140771b admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:36.385149 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-783913e9-b186-48db-88da-a9f8b140771b admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020448 Aug 10 11:26:36.385669 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 24/46] 10.222.0.62 () {60 vars in 1210 bytes} [Wed Aug 10 11:26:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:26:36.395630 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-9df96e9c-5c43-494b-8f60-b3b559911247 admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:36.400998 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.wsgi [None req-9df96e9c-5c43-494b-8f60-b3b559911247 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 10 11:26:36.402837 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-9df96e9c-5c43-494b-8f60-b3b559911247 admin admin] Request method failure captured: Aug 10 11:26:36.402837 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 10 11:26:36.402837 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: Accept: application/json Aug 10 11:26:36.402837 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: Accept-Encoding: gzip, deflate Aug 10 11:26:36.402837 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: Connection: keep-alive Aug 10 11:26:36.402837 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: Content-Length: 0 Aug 10 11:26:36.402837 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: Host: 10.222.0.62 Aug 10 11:26:36.402837 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: Openstack-Api-Version: compute 2.90 Aug 10 11:26:36.402837 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: Openstack-System-Scope: None Aug 10 11:26:36.402837 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: User-Agent: python-novaclient Aug 10 11:26:36.402837 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-Auth-Token: gAAAAABi85XrQqqp-9arOUXDAL-gqqjbUdWoZ-KCII2WLxSkxH30pkdq2bV8dbokawAMY8RClp8_9wNjgkdo0j66i59gRdRf60a4eMyNsfwTEgwdofnfBoajC5lwsk664ME-uqfb7TAiOu4LlpE_WQof2K1JPkXOCRDmC_U5p9urRcl354sf4cE Aug 10 11:26:36.402837 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-Domain-Id: None Aug 10 11:26:36.402837 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-Domain-Name: None Aug 10 11:26:36.402837 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-Identity-Status: Confirmed Aug 10 11:26:36.402837 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-Is-Admin-Project: True Aug 10 11:26:36.402837 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 11:26:36.402837 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-Project-Domain-Id: default Aug 10 11:26:36.402837 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-Project-Domain-Name: Default Aug 10 11:26:36.402837 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-Project-Id: a09e756d78584d0e8f8d4c39716e435d Aug 10 11:26:36.402837 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-Project-Name: admin Aug 10 11:26:36.402837 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-Role: member,admin,reader Aug 10 11:26:36.402837 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-Roles: member,admin,reader Aug 10 11:26:36.404416 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/a09e756d78584d0e8f8d4c39716e435d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_a09e756d78584d0e8f8d4c39716e435d", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a09e756d78584d0e8f8d4c39716e435d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a09e756d78584d0e8f8d4c39716e435d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:26:36.404416 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-Tenant: admin Aug 10 11:26:36.404416 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-Tenant-Id: a09e756d78584d0e8f8d4c39716e435d Aug 10 11:26:36.404416 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-Tenant-Name: admin Aug 10 11:26:36.404416 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-User: admin Aug 10 11:26:36.404416 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-User-Domain-Id: default Aug 10 11:26:36.404416 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-User-Domain-Name: Default Aug 10 11:26:36.404416 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-User-Id: 9099bf734514476a96c510cc6ad791bb Aug 10 11:26:36.404416 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-User-Name: admin Aug 10 11:26:36.404416 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: method: > Aug 10 11:26:36.404416 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: exception: Flavor 84 could not be found. Aug 10 11:26:36.404416 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: action_args: {'id': '84'} Aug 10 11:26:36.404416 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:26:36.404416 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:26:36.405313 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 11:26:36.405313 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 11:26:36.405313 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 11:26:36.405313 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 11:26:36.405313 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 11:26:36.405313 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 11:26:36.405313 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 11:26:36.405313 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 11:26:36.405313 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 11:26:36.405313 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:26:36.405313 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 11:26:36.405313 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 11:26:36.405313 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 10 11:26:36.405313 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Aug 10 11:26:36.405313 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:26:36.405313 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Aug 10 11:26:36.405313 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:26:36.405313 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:26:36.405313 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:26:36.406574 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:26:36.406574 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:26:36.406574 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:26:36.406574 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:26:36.406574 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 11:26:36.406574 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:26:36.406574 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 10 11:26:36.406574 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Aug 10 11:26:36.406574 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:26:36.406574 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Aug 10 11:26:36.406574 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:26:36.406574 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:26:36.406574 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:26:36.406574 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:26:36.406574 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:26:36.406574 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 10 11:26:36.406574 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Aug 10 11:26:36.406574 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-9df96e9c-5c43-494b-8f60-b3b559911247 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:26:36.408542 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-9df96e9c-5c43-494b-8f60-b3b559911247 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012672 Aug 10 11:26:36.408542 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 23/47] 10.222.0.62 () {60 vars in 1190 bytes} [Wed Aug 10 11:26:36 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 10 11:26:37.367483 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-783913e9-b186-48db-88da-a9f8b140771b admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:37.368530 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-783913e9-b186-48db-88da-a9f8b140771b admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Aug 10 11:26:37.368930 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 25/48] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Aug 10 11:26:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:26:37.893799 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-e4ec8b52-adbb-4486-95cb-cdfe0d49b645 admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:37.899511 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.wsgi [None req-e4ec8b52-adbb-4486-95cb-cdfe0d49b645 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 10 11:26:37.901047 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-e4ec8b52-adbb-4486-95cb-cdfe0d49b645 admin admin] Request method failure captured: Aug 10 11:26:37.901047 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 10 11:26:37.901047 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: Accept: application/json Aug 10 11:26:37.901047 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: Accept-Encoding: gzip, deflate Aug 10 11:26:37.901047 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: Connection: keep-alive Aug 10 11:26:37.901047 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: Content-Length: 0 Aug 10 11:26:37.901047 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: Host: 10.222.0.62 Aug 10 11:26:37.901047 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: Openstack-Api-Version: compute 2.90 Aug 10 11:26:37.901047 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: Openstack-System-Scope: None Aug 10 11:26:37.901047 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: User-Agent: python-novaclient Aug 10 11:26:37.901047 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-Auth-Token: gAAAAABi85XthPzoLePqpe3EXOxmAjLWX6KG_Xwk3YyEz_JwfzNIO-dzi6z8tzj2kz_twThMV-j1mCqwy_ffg5QZnRxEeTv7sH9LCUk-C5mNSAf2sikSMaTSEdzcz-2KlIqRLn-PB_oa9l0R5X7z5MDDVZv3mwYtSLhwvSU-WKMHMAJ-qDm2Pxw Aug 10 11:26:37.901047 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-Domain-Id: None Aug 10 11:26:37.901047 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-Domain-Name: None Aug 10 11:26:37.901047 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-Identity-Status: Confirmed Aug 10 11:26:37.901047 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-Is-Admin-Project: True Aug 10 11:26:37.901047 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 11:26:37.901047 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-Project-Domain-Id: default Aug 10 11:26:37.901047 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-Project-Domain-Name: Default Aug 10 11:26:37.901047 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-Project-Id: a09e756d78584d0e8f8d4c39716e435d Aug 10 11:26:37.901047 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-Project-Name: admin Aug 10 11:26:37.901047 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-Role: member,admin,reader Aug 10 11:26:37.901047 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-Roles: member,admin,reader Aug 10 11:26:37.902676 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/a09e756d78584d0e8f8d4c39716e435d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_a09e756d78584d0e8f8d4c39716e435d", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a09e756d78584d0e8f8d4c39716e435d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a09e756d78584d0e8f8d4c39716e435d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:26:37.902676 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-Tenant: admin Aug 10 11:26:37.902676 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-Tenant-Id: a09e756d78584d0e8f8d4c39716e435d Aug 10 11:26:37.902676 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-Tenant-Name: admin Aug 10 11:26:37.902676 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-User: admin Aug 10 11:26:37.902676 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-User-Domain-Id: default Aug 10 11:26:37.902676 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-User-Domain-Name: Default Aug 10 11:26:37.902676 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-User-Id: 9099bf734514476a96c510cc6ad791bb Aug 10 11:26:37.902676 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: X-User-Name: admin Aug 10 11:26:37.902676 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: method: > Aug 10 11:26:37.902676 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: exception: Flavor 451 could not be found. Aug 10 11:26:37.902676 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: action_args: {'id': '451'} Aug 10 11:26:37.902676 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:26:37.902676 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:26:37.903794 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 11:26:37.903794 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 11:26:37.903794 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 11:26:37.903794 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 11:26:37.903794 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 11:26:37.903794 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 11:26:37.903794 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 11:26:37.903794 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 11:26:37.903794 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 11:26:37.903794 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:26:37.903794 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 11:26:37.903794 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 11:26:37.903794 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 10 11:26:37.903794 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Aug 10 11:26:37.903794 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:26:37.903794 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Aug 10 11:26:37.903794 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:26:37.903794 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:26:37.903794 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:26:37.905215 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:26:37.905215 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:26:37.905215 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:26:37.905215 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:26:37.905215 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 11:26:37.905215 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:26:37.905215 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 10 11:26:37.905215 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Aug 10 11:26:37.905215 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:26:37.905215 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Aug 10 11:26:37.905215 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:26:37.905215 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:26:37.905215 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:26:37.905215 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:26:37.905215 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:26:37.905215 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 10 11:26:37.905215 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: ERROR nova.api.openstack.wsgi Aug 10 11:26:37.905215 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-e4ec8b52-adbb-4486-95cb-cdfe0d49b645 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:26:37.906530 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-e4ec8b52-adbb-4486-95cb-cdfe0d49b645 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.392846 Aug 10 11:26:37.906530 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 24/49] 10.222.0.62 () {60 vars in 1193 bytes} [Wed Aug 10 11:26:37 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 11:26:37.912837 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-a3eb484d-ed80-4759-ac49-7a84012bb9e2 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:37.927806 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-a3eb484d-ed80-4759-ac49-7a84012bb9e2 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018773 Aug 10 11:26:37.928398 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 26/50] 10.222.0.62 () {60 vars in 1210 bytes} [Wed Aug 10 11:26:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:26:37.937541 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-d370ad2d-e8ff-4b74-8801-84097fcb6834 admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:37.952161 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-d370ad2d-e8ff-4b74-8801-84097fcb6834 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018026 Aug 10 11:26:37.952669 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 25/51] 10.222.0.62 () {60 vars in 1210 bytes} [Wed Aug 10 11:26:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:26:37.962192 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-b1336d24-1c49-42de-a023-e02de8cb56e6 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:37.967477 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.wsgi [None req-b1336d24-1c49-42de-a023-e02de8cb56e6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 10 11:26:37.969000 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-b1336d24-1c49-42de-a023-e02de8cb56e6 admin admin] Request method failure captured: Aug 10 11:26:37.969000 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 10 11:26:37.969000 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: Accept: application/json Aug 10 11:26:37.969000 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: Accept-Encoding: gzip, deflate Aug 10 11:26:37.969000 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: Connection: keep-alive Aug 10 11:26:37.969000 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: Content-Length: 0 Aug 10 11:26:37.969000 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: Host: 10.222.0.62 Aug 10 11:26:37.969000 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: Openstack-Api-Version: compute 2.90 Aug 10 11:26:37.969000 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: Openstack-System-Scope: None Aug 10 11:26:37.969000 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: User-Agent: python-novaclient Aug 10 11:26:37.969000 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-Auth-Token: gAAAAABi85XthPzoLePqpe3EXOxmAjLWX6KG_Xwk3YyEz_JwfzNIO-dzi6z8tzj2kz_twThMV-j1mCqwy_ffg5QZnRxEeTv7sH9LCUk-C5mNSAf2sikSMaTSEdzcz-2KlIqRLn-PB_oa9l0R5X7z5MDDVZv3mwYtSLhwvSU-WKMHMAJ-qDm2Pxw Aug 10 11:26:37.969000 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-Domain-Id: None Aug 10 11:26:37.969000 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-Domain-Name: None Aug 10 11:26:37.969000 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-Identity-Status: Confirmed Aug 10 11:26:37.969000 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-Is-Admin-Project: True Aug 10 11:26:37.969000 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 11:26:37.969000 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-Project-Domain-Id: default Aug 10 11:26:37.969000 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-Project-Domain-Name: Default Aug 10 11:26:37.969000 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-Project-Id: a09e756d78584d0e8f8d4c39716e435d Aug 10 11:26:37.969000 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-Project-Name: admin Aug 10 11:26:37.969000 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-Role: member,admin,reader Aug 10 11:26:37.969000 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-Roles: member,admin,reader Aug 10 11:26:37.971226 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/a09e756d78584d0e8f8d4c39716e435d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_a09e756d78584d0e8f8d4c39716e435d", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a09e756d78584d0e8f8d4c39716e435d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a09e756d78584d0e8f8d4c39716e435d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:26:37.971226 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-Tenant: admin Aug 10 11:26:37.971226 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-Tenant-Id: a09e756d78584d0e8f8d4c39716e435d Aug 10 11:26:37.971226 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-Tenant-Name: admin Aug 10 11:26:37.971226 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-User: admin Aug 10 11:26:37.971226 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-User-Domain-Id: default Aug 10 11:26:37.971226 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-User-Domain-Name: Default Aug 10 11:26:37.971226 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-User-Id: 9099bf734514476a96c510cc6ad791bb Aug 10 11:26:37.971226 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: X-User-Name: admin Aug 10 11:26:37.971226 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: method: > Aug 10 11:26:37.971226 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: exception: Flavor 451 could not be found. Aug 10 11:26:37.971226 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: action_args: {'id': '451'} Aug 10 11:26:37.971226 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:26:37.971226 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:26:37.972126 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 11:26:37.972126 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 11:26:37.972126 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 11:26:37.972126 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 11:26:37.972126 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 11:26:37.972126 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 11:26:37.972126 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 11:26:37.972126 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 11:26:37.972126 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 11:26:37.972126 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:26:37.972126 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 11:26:37.972126 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 11:26:37.972126 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 10 11:26:37.972126 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Aug 10 11:26:37.972126 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:26:37.972126 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Aug 10 11:26:37.972126 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:26:37.972126 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:26:37.972126 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:26:37.973500 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:26:37.973500 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:26:37.973500 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:26:37.973500 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:26:37.973500 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 11:26:37.973500 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:26:37.973500 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 10 11:26:37.973500 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Aug 10 11:26:37.973500 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:26:37.973500 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Aug 10 11:26:37.973500 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:26:37.973500 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:26:37.973500 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:26:37.973500 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:26:37.973500 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:26:37.973500 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 10 11:26:37.973500 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Aug 10 11:26:37.973500 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-b1336d24-1c49-42de-a023-e02de8cb56e6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:26:37.974749 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-b1336d24-1c49-42de-a023-e02de8cb56e6 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011659 Aug 10 11:26:37.974749 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 27/52] 10.222.0.62 () {60 vars in 1193 bytes} [Wed Aug 10 11:26:37 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 11:26:38.951355 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-d370ad2d-e8ff-4b74-8801-84097fcb6834 admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:38.952554 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-d370ad2d-e8ff-4b74-8801-84097fcb6834 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001588 Aug 10 11:26:38.952989 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 26/53] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Aug 10 11:26:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:26:39.480383 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-39bc7a2c-856c-4046-8f5f-6b7fe23cbef4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:26:39.554203 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-39bc7a2c-856c-4046-8f5f-6b7fe23cbef4 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.462497 Aug 10 11:26:39.554746 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 28/54] 10.222.0.62 () {64 vars in 1235 bytes} [Wed Aug 10 11:26:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:26:40.518882 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-d370ad2d-e8ff-4b74-8801-84097fcb6834 admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:40.519885 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-d370ad2d-e8ff-4b74-8801-84097fcb6834 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Aug 10 11:26:40.520320 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 27/55] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Aug 10 11:26:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:26:41.049576 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-60edc1db-5b62-45bb-a4a6-732ece1cc935 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:26:41.165719 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-60edc1db-5b62-45bb-a4a6-732ece1cc935 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.504466 Aug 10 11:26:41.166272 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 29/56] 10.222.0.62 () {64 vars in 1235 bytes} [Wed Aug 10 11:26:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:26:42.135640 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-d370ad2d-e8ff-4b74-8801-84097fcb6834 admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:42.136940 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-d370ad2d-e8ff-4b74-8801-84097fcb6834 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001710 Aug 10 11:26:42.137340 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 28/57] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Aug 10 11:26:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:26:42.664043 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-9a76007f-a2a9-48d6-a3ef-087aa52b9365 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:26:42.729334 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-9a76007f-a2a9-48d6-a3ef-087aa52b9365 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.453896 Aug 10 11:26:42.729824 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 30/58] 10.222.0.62 () {64 vars in 1235 bytes} [Wed Aug 10 11:26:42 2022] POST /compute/v2.1/flavors => generated 407 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:26:43.704931 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-d370ad2d-e8ff-4b74-8801-84097fcb6834 admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:43.706021 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-d370ad2d-e8ff-4b74-8801-84097fcb6834 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002059 Aug 10 11:26:43.706411 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 29/59] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Aug 10 11:26:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:26:44.235576 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-e5334a3c-5810-4241-8a65-8b269c0d8373 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:26:44.301653 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-e5334a3c-5810-4241-8a65-8b269c0d8373 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.454427 Aug 10 11:26:44.302195 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 31/60] 10.222.0.62 () {64 vars in 1235 bytes} [Wed Aug 10 11:26:43 2022] POST /compute/v2.1/flavors => generated 409 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:26:45.273256 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-d370ad2d-e8ff-4b74-8801-84097fcb6834 admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:45.274256 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-d370ad2d-e8ff-4b74-8801-84097fcb6834 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 10 11:26:45.274646 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 30/61] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Aug 10 11:26:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:26:45.795545 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-cf7f545a-5d95-443d-8292-16706d8ef9f4 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:45.817314 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-cf7f545a-5d95-443d-8292-16706d8ef9f4 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.402263 Aug 10 11:26:45.817853 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 32/62] 10.222.0.62 () {60 vars in 1202 bytes} [Wed Aug 10 11:26:45 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:27:37.193847 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-d370ad2d-e8ff-4b74-8801-84097fcb6834 admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:37.194863 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-d370ad2d-e8ff-4b74-8801-84097fcb6834 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Aug 10 11:27:37.195263 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 31/63] 10.222.0.62 () {54 vars in 931 bytes} [Wed Aug 10 11:27:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:27:37.206985 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG dbcounter [-] [103523] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:27:37.591106 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-7012eba5-5479-4e3f-9a44-6b99fec29d11 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:37.612229 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-7012eba5-5479-4e3f-9a44-6b99fec29d11 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.410543 Aug 10 11:27:37.612695 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 33/64] 10.222.0.62 () {60 vars in 1292 bytes} [Wed Aug 10 11:27:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:27:37.636277 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-fb75097c-732a-476a-b560-781677ccd03d admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:37.640092 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG dbcounter [-] [103524] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:27:37.646900 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-fb75097c-732a-476a-b560-781677ccd03d admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014520 Aug 10 11:27:37.647464 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 32/65] 10.222.0.62 () {60 vars in 1283 bytes} [Wed Aug 10 11:27:37 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:27:37.661845 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-e074de80-1c2f-4fae-a593-5f1a21199d60 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:37.669511 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-e074de80-1c2f-4fae-a593-5f1a21199d60 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011336 Aug 10 11:27:37.670017 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 34/66] 10.222.0.62 () {60 vars in 1286 bytes} [Wed Aug 10 11:27:37 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:27:37.682269 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-04ffb856-9604-46f8-8e73-84142e4d2e53 admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:37.690900 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-04ffb856-9604-46f8-8e73-84142e4d2e53 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012566 Aug 10 11:27:37.693518 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 33/67] 10.222.0.62 () {60 vars in 1286 bytes} [Wed Aug 10 11:27:37 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:27:37.702477 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-5aeff474-3961-48a2-8a0a-bd9798678e56 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:37.710059 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-5aeff474-3961-48a2-8a0a-bd9798678e56 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011079 Aug 10 11:27:37.710566 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 35/68] 10.222.0.62 () {60 vars in 1283 bytes} [Wed Aug 10 11:27:37 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:37.588888 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-04ffb856-9604-46f8-8e73-84142e4d2e53 admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:37.589897 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-04ffb856-9604-46f8-8e73-84142e4d2e53 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Aug 10 11:30:37.590289 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 34/69] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Aug 10 11:30:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:30:37.729652 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG dbcounter [-] [103523] Writing DB stats nova_api:SELECT=6 {{(pid=103523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:37.885607 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-7a2b13ac-9353-4ae7-871b-63029fda584d admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:37.888276 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 11:30:37.888276 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: warnings.warn(msg) Aug 10 11:30:37.889393 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-7a2b13ac-9353-4ae7-871b-63029fda584d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:37.889867 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-7a2b13ac-9353-4ae7-871b-63029fda584d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:37.890294 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-7a2b13ac-9353-4ae7-871b-63029fda584d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:37.891003 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-7a2b13ac-9353-4ae7-871b-63029fda584d admin admin] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:37.891449 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-7a2b13ac-9353-4ae7-871b-63029fda584d admin admin] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:37.891863 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-7a2b13ac-9353-4ae7-871b-63029fda584d admin admin] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:37.926994 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-7a2b13ac-9353-4ae7-871b-63029fda584d admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.198859 Aug 10 11:30:37.927555 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 36/70] 10.222.0.62 () {60 vars in 1193 bytes} [Wed Aug 10 11:30:37 2022] GET /compute/v2.1/os-services => generated 791 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:30:38.755575 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-04ffb856-9604-46f8-8e73-84142e4d2e53 admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:38.756693 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-04ffb856-9604-46f8-8e73-84142e4d2e53 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001641 Aug 10 11:30:38.757149 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 35/71] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Aug 10 11:30:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:30:38.950504 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-6343b025-9226-48a8-8204-3abe6f49f8de admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:38.953069 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 11:30:38.953069 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: warnings.warn(msg) Aug 10 11:30:38.954280 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-6343b025-9226-48a8-8204-3abe6f49f8de admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:38.954755 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-6343b025-9226-48a8-8204-3abe6f49f8de admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:38.955184 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-6343b025-9226-48a8-8204-3abe6f49f8de admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:38.956575 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-6343b025-9226-48a8-8204-3abe6f49f8de admin admin] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:38.956924 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-6343b025-9226-48a8-8204-3abe6f49f8de admin admin] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:38.957340 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-6343b025-9226-48a8-8204-3abe6f49f8de admin admin] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:38.978834 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-6343b025-9226-48a8-8204-3abe6f49f8de admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.080129 Aug 10 11:30:38.979349 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 37/72] 10.222.0.62 () {60 vars in 1193 bytes} [Wed Aug 10 11:30:38 2022] GET /compute/v2.1/os-services => generated 791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:30:50.203235 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-04ffb856-9604-46f8-8e73-84142e4d2e53 admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:50.204277 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-04ffb856-9604-46f8-8e73-84142e4d2e53 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Aug 10 11:30:50.204676 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 36/73] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Aug 10 11:30:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:30:50.349178 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG dbcounter [-] [103523] Writing DB stats nova_cell0:SELECT=4 {{(pid=103523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:50.349907 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG dbcounter [-] [103523] Writing DB stats nova_cell1:SELECT=4 {{(pid=103523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:50.350514 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG dbcounter [-] [103523] Writing DB stats nova_api:SELECT=8 {{(pid=103523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:50.398342 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-f10d1128-e3fd-40c8-b759-3ec3765f2bf0 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:50.406124 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 11:30:50.406124 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: warnings.warn(msg) Aug 10 11:30:50.406124 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-f10d1128-e3fd-40c8-b759-3ec3765f2bf0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:50.406124 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-f10d1128-e3fd-40c8-b759-3ec3765f2bf0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:50.406124 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-f10d1128-e3fd-40c8-b759-3ec3765f2bf0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:50.406124 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-f10d1128-e3fd-40c8-b759-3ec3765f2bf0 admin admin] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:50.406666 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-f10d1128-e3fd-40c8-b759-3ec3765f2bf0 admin admin] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:50.406666 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-f10d1128-e3fd-40c8-b759-3ec3765f2bf0 admin admin] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:50.430633 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-f10d1128-e3fd-40c8-b759-3ec3765f2bf0 admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.086831 Aug 10 11:30:50.431201 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 38/74] 10.222.0.62 () {60 vars in 1193 bytes} [Wed Aug 10 11:30:50 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:30:51.264398 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: DEBUG nova.api.openstack.wsgi [None req-04ffb856-9604-46f8-8e73-84142e4d2e53 admin admin] Calling method '>' {{(pid=103524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:51.265415 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: INFO nova.api.openstack.requestlog [None req-04ffb856-9604-46f8-8e73-84142e4d2e53 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Aug 10 11:30:51.265804 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: [pid: 103524|app: 0|req: 37/75] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Aug 10 11:30:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:30:51.454201 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-a5688c49-652a-4fcb-a18b-5914c6bc9bd6 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:51.457208 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 11:30:51.457208 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: warnings.warn(msg) Aug 10 11:30:51.458293 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-a5688c49-652a-4fcb-a18b-5914c6bc9bd6 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:51.458771 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-a5688c49-652a-4fcb-a18b-5914c6bc9bd6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:51.459200 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-a5688c49-652a-4fcb-a18b-5914c6bc9bd6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:51.459902 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-a5688c49-652a-4fcb-a18b-5914c6bc9bd6 admin admin] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:51.460374 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-a5688c49-652a-4fcb-a18b-5914c6bc9bd6 admin admin] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:51.460787 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-a5688c49-652a-4fcb-a18b-5914c6bc9bd6 admin admin] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:51.482491 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-a5688c49-652a-4fcb-a18b-5914c6bc9bd6 admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079886 Aug 10 11:30:51.483032 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 39/76] 10.222.0.62 () {60 vars in 1193 bytes} [Wed Aug 10 11:30:51 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:31:47.315893 dv-cinder-852725-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 10 11:31:47.316442 dv-cinder-852725-3-iscsi devstack@n-api.service[103522]: Wed Aug 10 11:31:47 2022 - graceful shutdown triggered... Aug 10 11:31:47.316891 dv-cinder-852725-3-iscsi devstack@n-api.service[103523]: Gracefully killing worker 1 (pid: 103523)... Aug 10 11:31:47.317257 dv-cinder-852725-3-iscsi devstack@n-api.service[103524]: Gracefully killing worker 2 (pid: 103524)... Aug 10 11:31:48.317448 dv-cinder-852725-3-iscsi devstack@n-api.service[103522]: worker 1 buried after 1 seconds Aug 10 11:31:48.317448 dv-cinder-852725-3-iscsi devstack@n-api.service[103522]: worker 2 buried after 1 seconds Aug 10 11:31:48.317448 dv-cinder-852725-3-iscsi devstack@n-api.service[103522]: goodbye to uWSGI. Aug 10 11:31:48.319019 dv-cinder-852725-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 10 11:31:48.319565 dv-cinder-852725-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 10 11:31:48.322392 dv-cinder-852725-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 10 11:31:48.335609 dv-cinder-852725-3-iscsi devstack@n-api.service[124665]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 10 11:31:48.337934 dv-cinder-852725-3-iscsi devstack@n-api.service[124665]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 10 11:31:48 2022] *** Aug 10 11:31:48.337934 dv-cinder-852725-3-iscsi devstack@n-api.service[124665]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 10 11:31:48.337934 dv-cinder-852725-3-iscsi devstack@n-api.service[124665]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 10 11:31:48.337934 dv-cinder-852725-3-iscsi devstack@n-api.service[124665]: nodename: dv-cinder-852725-3-iscsi Aug 10 11:31:48.337934 dv-cinder-852725-3-iscsi devstack@n-api.service[124665]: machine: x86_64 Aug 10 11:31:48.337934 dv-cinder-852725-3-iscsi devstack@n-api.service[124665]: clock source: unix Aug 10 11:31:48.337934 dv-cinder-852725-3-iscsi devstack@n-api.service[124665]: pcre jit disabled Aug 10 11:31:48.337934 dv-cinder-852725-3-iscsi devstack@n-api.service[124665]: detected number of CPU cores: 4 Aug 10 11:31:48.337934 dv-cinder-852725-3-iscsi devstack@n-api.service[124665]: current working directory: / Aug 10 11:31:48.337934 dv-cinder-852725-3-iscsi devstack@n-api.service[124665]: detected binary path: /usr/bin/uwsgi-core Aug 10 11:31:48.338736 dv-cinder-852725-3-iscsi devstack@n-api.service[124665]: your processes number limit is 47680 Aug 10 11:31:48.338736 dv-cinder-852725-3-iscsi devstack@n-api.service[124665]: your memory page size is 4096 bytes Aug 10 11:31:48.338736 dv-cinder-852725-3-iscsi devstack@n-api.service[124665]: detected max file descriptor number: 2048 Aug 10 11:31:48.338736 dv-cinder-852725-3-iscsi devstack@n-api.service[124665]: lock engine: pthread robust mutexes Aug 10 11:31:48.338736 dv-cinder-852725-3-iscsi devstack@n-api.service[124665]: thunder lock: enabled Aug 10 11:31:48.338736 dv-cinder-852725-3-iscsi devstack@n-api.service[124665]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 10 11:31:48.338736 dv-cinder-852725-3-iscsi devstack@n-api.service[124665]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 10 11:31:48.380248 dv-cinder-852725-3-iscsi devstack@n-api.service[124665]: Python main interpreter initialized at 0x55a2c3e399c0 Aug 10 11:31:48.380248 dv-cinder-852725-3-iscsi devstack@n-api.service[124665]: python threads support enabled Aug 10 11:31:48.380248 dv-cinder-852725-3-iscsi devstack@n-api.service[124665]: your server socket listen backlog is limited to 100 connections Aug 10 11:31:48.380248 dv-cinder-852725-3-iscsi devstack@n-api.service[124665]: your mercy for graceful operations on workers is 90 seconds Aug 10 11:31:48.380726 dv-cinder-852725-3-iscsi devstack@n-api.service[124665]: mapped 403077 bytes (393 KB) for 2 cores Aug 10 11:31:48.380726 dv-cinder-852725-3-iscsi devstack@n-api.service[124665]: *** Operational MODE: preforking *** Aug 10 11:31:48.380957 dv-cinder-852725-3-iscsi devstack@n-api.service[124665]: *** uWSGI is running in multiple interpreter mode *** Aug 10 11:31:48.380957 dv-cinder-852725-3-iscsi devstack@n-api.service[124665]: spawned uWSGI master process (pid: 124665) Aug 10 11:31:48.381163 dv-cinder-852725-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 10 11:31:48.381707 dv-cinder-852725-3-iscsi devstack@n-api.service[124665]: spawned uWSGI worker 1 (pid: 124682, cores: 1) Aug 10 11:31:48.382200 dv-cinder-852725-3-iscsi devstack@n-api.service[124665]: spawned uWSGI worker 2 (pid: 124683, cores: 1) Aug 10 11:31:48.382482 dv-cinder-852725-3-iscsi devstack@n-api.service[124665]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 10 11:31:49.045561 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 11:31:49.052463 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 11:31:50.199610 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 11:31:50.199610 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: from cryptography.utils import int_from_bytes Aug 10 11:31:50.200208 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 11:31:50.200208 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: from cryptography.utils import int_from_bytes Aug 10 11:31:50.208128 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 11:31:50.208128 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: from cryptography.utils import int_from_bytes Aug 10 11:31:50.208620 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 11:31:50.208620 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: from cryptography.utils import int_from_bytes Aug 10 11:31:52.521595 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 11:31:52.522163 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 11:31:52.522458 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 11:31:52.522761 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 11:31:52.523024 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 11:31:52.523417 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.523750 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.524117 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.524441 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.524773 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.525090 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.525416 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.525739 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.526075 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.526340 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.526658 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.526928 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 11:31:52.527448 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852725-3-iscsi {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.527540 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 11:31:52.527624 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.527624 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.527825 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 11:31:52.527937 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.528130 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 11:31:52.528301 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.528457 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 11:31:52.528591 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.528843 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.528945 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.529039 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.529122 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.529371 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.529615 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.529742 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.530014 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.530142 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.530331 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.530448 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.530654 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.530761 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.530975 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.531094 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.531299 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.531436 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.531595 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.531694 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.531879 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.532030 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.532784 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.532890 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852725-3-iscsi {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.533112 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.533214 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.533426 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.533619 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.533788 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.534025 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852725-3-iscsi {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.534182 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.534332 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.534500 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.534657 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.534800 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.534952 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.535093 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.535375 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.535530 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.535769 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.535922 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.536111 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.536255 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.536406 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.536563 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.536715 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.536864 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.537018 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.537203 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.537349 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.537512 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.537662 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.537809 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.537970 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.538141 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.538285 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.538460 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.538622 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.538773 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.538923 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.539090 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852725-3-iscsi {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.539243 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.539396 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.539539 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.539681 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.539821 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.539985 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.540153 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.540297 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.540447 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.540597 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.540746 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.540901 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.541049 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.541192 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.541343 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.541485 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.541633 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.541794 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.541936 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.542078 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.542231 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.542373 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.542529 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.542672 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.542824 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.542986 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.543136 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.543288 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.543440 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.543582 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.543724 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.543872 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.544056 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.544330 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.544501 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.544656 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.545412 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.545578 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.545747 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.545900 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.546053 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.546202 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.546357 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.546499 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.546650 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.546803 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.546965 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.547112 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.547261 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.547261 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.547559 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.547724 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.547944 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.548125 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.548269 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.548412 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.548568 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.548719 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.548871 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.550080 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.550245 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.550399 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.550568 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.550718 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.550860 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.551011 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.551164 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.551312 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.551468 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.551611 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.551752 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.551904 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.552232 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.552385 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.552541 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.552888 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.552888 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.553178 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.553320 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.553474 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.553474 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.553758 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.553905 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.554064 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.554213 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.554369 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.554520 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.554670 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.554861 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.555095 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.555249 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.555402 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.555551 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.555701 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.555841 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.556008 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.556156 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.556312 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.556468 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.556618 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.556766 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.556918 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.557080 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.557223 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.557374 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.557523 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.557671 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.557813 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.557967 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.558118 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.558266 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.558409 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.558558 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.558716 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.558871 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.559023 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.559172 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.559314 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.559456 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.559598 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.559747 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.559890 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.560092 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.560248 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.560408 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.560553 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.560711 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.560864 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.561012 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.561163 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.561305 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.561463 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.561606 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.561754 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.561904 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.562047 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.562187 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.562336 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.562478 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.562638 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.562792 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.562943 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.563085 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.563234 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.563898 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.564136 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.564338 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.564533 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.564719 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.564913 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.565104 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.565301 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.565582 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.565741 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.565891 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.566047 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.566197 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.566345 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.566495 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.566646 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.566797 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.566962 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.566962 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.567241 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.567393 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.567553 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.567706 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.567849 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.568049 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.568199 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.568349 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.568498 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.568655 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.568806 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.568959 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.569102 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.569245 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.569406 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.569567 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.569847 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.569993 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.570143 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.570287 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.570287 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.570684 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.570837 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.570981 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.571206 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.571364 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.571519 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.571674 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.571825 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.571997 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.572150 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.572302 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.572461 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.572603 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.572745 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.572894 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.573036 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.573179 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.573335 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.573484 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.573644 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.573793 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.573943 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.574103 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.574254 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.574395 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.574548 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:31:52.574699 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.574842 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.574998 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.575149 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.576108 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.576203 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.576281 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.576363 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.576447 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.576522 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.576599 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.576671 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.576741 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.576820 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.576905 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.576985 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.577065 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.577145 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.577225 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.577303 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.577375 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.577454 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.577525 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.577596 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.577673 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.577750 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.577834 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.577907 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.577977 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.578052 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.578123 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.578200 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.578280 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.578360 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.578438 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.578510 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.578580 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.578652 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.578731 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.578803 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.578880 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.579004 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.579628 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.579736 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.579867 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.580034 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.580230 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.580380 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.580529 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.580682 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.580788 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.580863 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.580933 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.581002 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.581247 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.581353 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.581606 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.581729 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.581930 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.582088 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.582234 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.582392 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.582546 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.582688 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.582838 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.582989 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.583132 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.583289 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.583433 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.583594 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.583768 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.583928 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.584108 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.584274 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.584426 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.584570 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.584721 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.584864 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.585015 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.585164 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.585315 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.585646 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.585829 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.586048 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.586206 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.586351 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.586492 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.586634 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.586634 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.586914 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.586914 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.587206 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.587349 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.587491 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.587643 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.587786 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.587938 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.589107 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.589286 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.589435 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.589435 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.589724 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.589878 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.590031 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.590183 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.590326 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.590469 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.590700 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.590847 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.590998 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.590998 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.591436 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.591436 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.591759 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.591759 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.592129 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.592302 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.592568 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.592732 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.592896 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.592896 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.593195 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.593347 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.593498 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.593655 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.593806 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.593958 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.594108 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.594252 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.594401 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.594559 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.594712 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.594950 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.595172 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.595424 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.595673 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.595844 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.596011 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.596164 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.596324 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.596469 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.596611 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.596767 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.596767 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.596767 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.597197 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.597341 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.597497 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.597641 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.597790 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.597932 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.598074 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.598216 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.598369 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.598521 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.598670 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.599280 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.599435 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.599591 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.599748 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.599893 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.600058 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.600203 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.600361 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.600506 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.600661 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.600813 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.600955 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.601098 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.601248 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.601557 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.601720 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.601874 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.602106 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.602255 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.602398 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.602555 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.602707 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.602859 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.603001 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.603153 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.603295 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.603448 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.603602 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.603752 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.603894 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.604070 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.604223 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.604381 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.604533 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.604677 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.604819 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.604968 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.605123 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.605275 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.605417 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.605577 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.605769 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.605931 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.606085 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.606236 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.606386 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.606538 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.606689 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.606833 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.606989 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.607140 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.607282 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.607424 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.607577 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.607721 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.607876 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.608091 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.608257 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.608402 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.608552 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.608709 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.608852 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.609459 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.609620 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.609773 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.609918 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.610081 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.610484 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.610733 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.610970 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.611124 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.611267 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.611425 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.611747 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.611908 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.612091 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.612303 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.612462 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.612623 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.612820 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.612970 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.613119 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.613261 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.613403 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.613560 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.613710 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.613854 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.614004 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.614163 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.614314 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.614457 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.614598 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.614751 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.614901 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.615143 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.615307 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.615453 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.615604 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.615792 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.615947 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.616134 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.616293 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.616438 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.616587 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.616741 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.616891 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.617034 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.617185 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.617329 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.617478 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.617629 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.617771 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.617941 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.618113 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.618296 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.618450 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.618593 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.618757 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.618914 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.619084 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.619664 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.619818 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.619989 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.620140 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.620303 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.620455 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.620607 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.620758 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.620913 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.621057 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.621220 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.621372 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.621524 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.621686 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.621972 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.622308 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.622750 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.622948 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.623109 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.623261 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.623422 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.623586 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.623744 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.623912 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.624096 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.624258 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.624408 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.624566 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.624716 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.624873 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.625022 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.625178 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.625338 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.625496 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.625647 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.625806 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.626613 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.626937 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.627194 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.627419 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.627579 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.627730 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.627879 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.628078 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.628251 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.628409 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.628568 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.628717 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.628717 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.629021 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.629179 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.629810 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.629991 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.630151 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.630309 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.630459 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.630617 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.630768 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.630926 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.631076 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.631231 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.631400 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.631559 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.631710 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.632017 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.632188 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.632346 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.632523 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.632743 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.632899 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.633056 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.633205 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.633361 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.633525 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.633694 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.633852 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.634002 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.634159 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.634307 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.634470 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.634626 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.634784 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.634934 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.635102 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.635270 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.635430 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.635580 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.635741 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.635898 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.636085 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.636247 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.636450 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.636450 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.636759 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.636917 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.637072 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.637231 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.637380 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.637528 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.637688 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.637845 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.638003 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.638164 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.638321 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.638726 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.638885 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.639034 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.639193 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.639343 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.639519 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.640370 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.640551 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.640724 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.640873 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.640873 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.641156 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.641312 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.641476 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.642432 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.642600 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.642798 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.643238 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.643416 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.643578 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.643737 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.643909 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.644085 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.644237 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.644405 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.644565 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.644714 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.644862 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.645054 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.645214 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.645364 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.645522 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.645679 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.645839 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.645998 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.646150 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.646306 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.646463 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.646660 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.646824 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.646992 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.647285 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.647463 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.647617 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.647765 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.647929 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.648222 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.648374 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.648534 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.648694 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.648851 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.649059 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.649221 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.649382 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.649540 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.649744 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.649744 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.650530 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.650690 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.650690 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.650987 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.651145 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.651304 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.651454 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.651611 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.651770 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.651919 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.652092 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.652255 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.652573 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.652730 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.652889 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.653050 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.653281 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.653447 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.653447 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.653750 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.653910 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.654061 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.654222 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.654381 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.654570 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.654729 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.654879 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.655048 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.655212 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.655378 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.655554 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.655801 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.656023 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.656181 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.656181 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.656493 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.656687 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.656849 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.657010 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.657208 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.657605 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.657867 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.658123 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.658327 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.658481 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.658642 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.658801 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.658959 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.659110 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.659259 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.659408 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.659571 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.659729 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.659912 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.660594 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.660787 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.661031 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.661199 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.661359 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.661517 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.661667 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.661825 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.661977 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.662140 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.662292 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.662450 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.662787 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.662952 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.663116 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.663288 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.663486 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.663656 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.663807 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.664001 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.664173 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.664326 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.664484 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.664634 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.664795 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.664951 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.665115 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.665273 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.665425 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.665574 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.665723 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.665881 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.666112 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.666264 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.666414 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.666563 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.666765 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.666942 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.667093 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.667242 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.667390 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.667548 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.667697 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.667697 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.668019 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.668184 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.668334 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.668492 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.668650 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.668809 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.668978 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.669136 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.669286 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.669435 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.669585 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.669749 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.669898 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.670054 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.670585 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.670833 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.670999 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.671262 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.671417 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.671580 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.671745 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.671897 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.672112 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.672266 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.672415 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.672572 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.672930 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.673189 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.673189 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.673663 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.673821 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.673971 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.674144 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.674302 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.674462 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.674612 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.674761 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.674918 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.675068 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.675231 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.675388 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.675658 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.675829 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.676008 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.676188 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.676352 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.676503 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.676656 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.676859 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.677022 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.677245 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.677418 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.677570 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.677719 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.677876 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.678026 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.678184 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.678356 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.678516 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.678666 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.678824 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.678974 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.679123 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.679281 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.679431 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.679587 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.679745 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.679902 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.680092 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.680244 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.680773 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.681031 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.681198 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.681451 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.681618 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.681770 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.681920 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.682077 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.682243 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.682392 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.682551 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.682701 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.682875 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.683192 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.683345 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.683502 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.683661 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.683811 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.684013 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.684182 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.684343 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.684503 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.684662 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.684811 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.684968 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.685125 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.685294 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.685458 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.685608 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.685766 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.685916 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.686072 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.686229 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.686388 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.686548 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.686697 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.686897 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.687054 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.687222 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.687386 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.687537 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.687685 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.687835 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.688015 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.688182 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.688861 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.689034 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.689286 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.689543 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.689801 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.689974 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.690138 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.690288 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.690437 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.690964 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.691238 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.691411 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.691752 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.691911 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.691911 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.692274 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.692425 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.692609 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.692888 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.693238 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.693407 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.693407 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.693702 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.693853 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.694002 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.694151 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.694299 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.694454 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.694612 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.694764 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.694912 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.695072 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.695222 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.695379 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.695546 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.695696 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.695853 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.696035 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.696200 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.696350 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.696513 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.696664 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.696820 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.697026 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.697196 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.697357 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.697507 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.697663 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.697812 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.697970 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.698128 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.698287 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.698436 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.698599 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.698756 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.698915 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.699072 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.699308 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.699468 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.699618 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.699767 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.699916 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.700123 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.700289 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.700439 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.700631 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.701143 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.701399 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.701575 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.701839 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.702013 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.702166 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.702315 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.702478 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.702636 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.702796 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.702952 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.703104 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.703401 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.703569 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.703722 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.703870 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.704333 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.704587 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.704837 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.704998 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.705148 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.705298 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.705456 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.705615 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.705775 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.705932 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.706081 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.706239 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.706389 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.706549 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.706709 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.706872 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.707072 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.707236 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.707395 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.707560 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.707710 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.707858 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.708025 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.708181 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.708350 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.708515 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.708677 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.708835 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.708984 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.709133 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.709289 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.709453 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.709610 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.709767 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.709923 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.709923 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.710215 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.710215 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.710525 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.710674 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.710831 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.711328 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.711601 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.711768 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.712069 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.712229 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.712322 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.712444 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.712560 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.712657 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.712751 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.712843 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.712928 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.713012 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.713147 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.713267 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.713536 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.713656 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.713777 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.713898 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.714018 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.714131 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.714251 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.714370 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.714481 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.714606 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.714720 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.714831 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.714949 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.715061 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.715169 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.715294 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.715414 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.715533 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.715645 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.715763 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.715881 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.716024 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.716150 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.716271 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.716381 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.716506 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.716618 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.716747 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.716871 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.716991 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.717159 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.717279 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.717398 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.717511 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.717620 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.717729 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.717848 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.717960 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.718082 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.718202 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.718320 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.718439 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.718549 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.718668 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.718792 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.718905 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.719014 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.719132 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.719242 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.719353 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.719476 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.720320 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.720557 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.720760 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.720929 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.721499 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.721733 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.721860 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.721988 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.722211 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.722328 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.722462 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.722574 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.722693 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.722811 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.722928 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.723116 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.723244 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.723364 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.723495 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.723762 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.723883 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.724014 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.724147 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.724269 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.724381 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.724490 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.724608 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.724728 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.724847 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.724965 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.725077 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.725189 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.725307 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.725427 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.725546 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.725656 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.725766 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.725883 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.726001 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.726001 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.726001 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.726001 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.726001 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.726522 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.726642 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.726767 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.726880 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.726880 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.727084 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.727084 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.727367 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.727481 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.727591 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.727708 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.727827 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.727938 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.728102 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.728270 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.728402 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.728514 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.728632 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.728743 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.728863 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.728993 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.729240 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.729359 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.729470 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.729595 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.729708 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.729825 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.729936 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.730046 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.730156 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.730279 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.730399 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.730517 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.730628 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.730745 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.730856 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.730979 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.731091 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.731562 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.731683 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.731897 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.732047 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.732047 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.732412 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.732412 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.732636 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.732757 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.732870 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.732979 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.733089 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.733197 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.733306 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.733435 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.733556 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.733807 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.733925 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.734044 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.734156 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.734285 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.734398 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.734509 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.734628 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.734739 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.734859 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.734859 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.735085 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.735226 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.735905 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.736185 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.736402 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.736591 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.736776 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.736962 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.737167 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.737432 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.737629 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.737751 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.737863 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.737973 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.738092 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.738212 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.738338 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.738450 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.738568 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.738689 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.738811 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.738937 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.739049 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.739159 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.739277 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.739396 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.739515 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.739644 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.739758 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.739878 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.740010 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.740143 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.740266 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.740387 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.740506 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.740618 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.740728 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.740840 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.740957 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.741078 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.741188 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.741317 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.741783 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.741917 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.742130 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.742255 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.742367 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.742585 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.742710 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.742822 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.742943 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.743062 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.743180 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.743300 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.743419 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.743539 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.743659 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.743916 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.744194 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.744334 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.744447 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.744557 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.744681 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.744794 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.744903 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.745054 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.745179 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.745301 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.745412 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.745522 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.745631 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.745749 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.745868 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.745993 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.746106 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.746223 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.746342 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.746461 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.746579 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.746759 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.746873 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.746983 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.747249 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.747426 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.747545 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.747666 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.747785 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.747896 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.748102 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.748232 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.748353 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.748472 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.748590 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.748700 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.748809 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.748926 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.749052 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.749164 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.749275 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.749385 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.749502 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.749613 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.749732 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.749885 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.749995 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.750105 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.750214 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.750332 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.750455 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.750576 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.750686 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.750796 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.751087 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.751282 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.751489 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.752394 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.752643 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.752978 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.753106 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.753236 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.753358 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.753480 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.753592 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.753702 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.753820 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.754108 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.754223 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.754334 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.754445 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.754556 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.754675 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.754797 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.754908 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.755026 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.755138 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.755248 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.755367 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.755478 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.755589 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.755699 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.755817 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.755947 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.756196 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.756325 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.756444 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.756556 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.756674 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.756793 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.756914 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.757038 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.757164 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.757284 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.757395 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.757550 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.757680 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.757795 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.757904 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.758014 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.758130 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.758250 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.758362 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.758472 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.758581 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.758700 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.758811 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.758929 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.758929 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.759144 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.759256 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.759373 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.759484 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.759603 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.759725 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.759835 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.759944 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.760078 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.760218 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.760339 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.760459 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.760577 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.760696 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.760815 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.760946 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.761058 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.761168 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.761277 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.761388 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.761504 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.761628 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.761844 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.762245 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.762390 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.762597 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.762725 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.762839 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.762958 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.763077 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.763213 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.763678 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.763809 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.763923 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.764195 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.764308 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.764431 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.764552 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.764673 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.764793 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.764905 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.765023 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.765134 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.765251 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.765376 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.765489 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.765613 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.765732 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.765851 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.765977 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.766090 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.766201 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.766319 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.767411 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.767587 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.767710 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.767821 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.767950 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.768123 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.768246 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.768370 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.768508 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.768623 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.768749 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.768862 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.768973 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.769093 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.769207 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.769317 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.769441 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.769554 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.769673 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.769792 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.769912 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.770037 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.770151 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.770270 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.770382 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.770493 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.770603 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.770728 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.770850 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.770970 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.771083 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.771194 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.771306 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.771425 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.771538 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.771655 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.771767 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.772009 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.772673 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.772904 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.773032 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.773153 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.773266 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.773414 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.773647 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.773773 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.773887 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.773997 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.774268 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.774398 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.774523 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.774634 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.774634 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.774841 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.774951 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.775061 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.775183 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.775304 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.775415 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.775526 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.775655 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.775912 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.776124 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.776251 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.776362 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.776473 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.776597 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.776727 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.776854 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.776967 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.777087 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.777206 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.777322 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.777447 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.777560 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.777725 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.777840 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.777966 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.778078 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.778198 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.778336 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.778643 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.778770 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.778882 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.779007 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.779127 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.779245 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.779357 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.779474 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.779592 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.779716 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.779828 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.779939 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.780072 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.780440 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.780557 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.780682 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.780796 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.780914 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.781041 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.781185 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.781307 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.781432 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.781553 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.781834 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.781969 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.783344 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.783525 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.783671 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.783770 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.783858 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.783944 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.784150 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.784326 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.784425 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.784520 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.784614 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.784707 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.784800 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.784901 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.784989 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.785081 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.785174 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.785260 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.785357 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.785445 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.785529 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.785614 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.785699 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.785784 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.785970 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.786080 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.786175 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.786270 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.786358 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.786456 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.786553 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.786648 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.786742 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.786828 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.786913 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.787007 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.787101 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.787185 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.787264 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.787350 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.787434 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.787532 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.787619 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.787724 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.787814 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.787907 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.788008 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.788117 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.788204 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.788297 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.788388 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.788487 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.788583 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.788669 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.788753 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.788837 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.788921 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.789005 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.789103 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.789190 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.789281 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.789367 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.789461 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.789555 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.789649 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.789736 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.789820 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.789910 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.789996 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.790082 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.790178 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.790265 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:31:52.790358 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 11:31:52.790445 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 11:31:52.942897 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO dbcounter [None req-e72e6fac-0a10-42db-a141-c6a238b73293 None None] Registered counter for database nova_api Aug 10 11:31:52.946779 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO dbcounter [None req-771be2ba-4ee5-4173-98bf-0a9c55785bf7 None None] Registered counter for database nova_api Aug 10 11:31:52.963632 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_db.sqlalchemy.engines [None req-e72e6fac-0a10-42db-a141-c6a238b73293 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 11:31:52.969397 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_db.sqlalchemy.engines [None req-771be2ba-4ee5-4173-98bf-0a9c55785bf7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124682) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 11:31:52.972371 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writer thread running {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 11:31:52.976735 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writer thread running {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 11:31:53.029939 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.context [None req-e72e6fac-0a10-42db-a141-c6a238b73293 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),57932da1-fc7c-42ec-b0c9-ecc094a8eac1(cell1) {{(pid=124683) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 11:31:53.033338 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.context [None req-771be2ba-4ee5-4173-98bf-0a9c55785bf7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),57932da1-fc7c-42ec-b0c9-ecc094a8eac1(cell1) {{(pid=124682) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 11:31:53.034086 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e72e6fac-0a10-42db-a141-c6a238b73293 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:53.034572 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e72e6fac-0a10-42db-a141-c6a238b73293 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:53.036203 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e72e6fac-0a10-42db-a141-c6a238b73293 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:53.036944 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e72e6fac-0a10-42db-a141-c6a238b73293 None None] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:53.037353 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-771be2ba-4ee5-4173-98bf-0a9c55785bf7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:53.037463 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e72e6fac-0a10-42db-a141-c6a238b73293 None None] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:53.037835 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-771be2ba-4ee5-4173-98bf-0a9c55785bf7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:53.039400 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e72e6fac-0a10-42db-a141-c6a238b73293 None None] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:53.039508 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-771be2ba-4ee5-4173-98bf-0a9c55785bf7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:53.040164 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-771be2ba-4ee5-4173-98bf-0a9c55785bf7 None None] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:53.040617 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-771be2ba-4ee5-4173-98bf-0a9c55785bf7 None None] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:53.041440 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO dbcounter [None req-e72e6fac-0a10-42db-a141-c6a238b73293 None None] Registered counter for database nova_cell0 Aug 10 11:31:53.042618 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-771be2ba-4ee5-4173-98bf-0a9c55785bf7 None None] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:53.044646 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO dbcounter [None req-771be2ba-4ee5-4173-98bf-0a9c55785bf7 None None] Registered counter for database nova_cell0 Aug 10 11:31:53.045515 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO dbcounter [None req-e72e6fac-0a10-42db-a141-c6a238b73293 None None] Registered counter for database nova_cell1 Aug 10 11:31:53.049638 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO dbcounter [None req-771be2ba-4ee5-4173-98bf-0a9c55785bf7 None None] Registered counter for database nova_cell1 Aug 10 11:31:53.052909 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_db.sqlalchemy.engines [None req-e72e6fac-0a10-42db-a141-c6a238b73293 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 11:31:53.056901 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_db.sqlalchemy.engines [None req-771be2ba-4ee5-4173-98bf-0a9c55785bf7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124682) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 11:31:53.058241 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_db.sqlalchemy.engines [None req-771be2ba-4ee5-4173-98bf-0a9c55785bf7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124682) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 11:31:53.058383 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writer thread running {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 11:31:53.059807 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_db.sqlalchemy.engines [None req-e72e6fac-0a10-42db-a141-c6a238b73293 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 11:31:53.065617 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writer thread running {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 11:31:53.068311 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writer thread running {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 11:31:53.201386 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writer thread running {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 11:31:53.210010 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO dbcounter [None req-e72e6fac-0a10-42db-a141-c6a238b73293 None None] Registered counter for database nova_cell0 Aug 10 11:31:53.212385 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO dbcounter [None req-771be2ba-4ee5-4173-98bf-0a9c55785bf7 None None] Registered counter for database nova_cell0 Aug 10 11:31:53.216706 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_db.sqlalchemy.engines [None req-e72e6fac-0a10-42db-a141-c6a238b73293 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 11:31:53.218567 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_db.sqlalchemy.engines [None req-771be2ba-4ee5-4173-98bf-0a9c55785bf7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124682) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 11:31:53.221850 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writer thread running {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 11:31:53.224306 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writer thread running {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 11:31:53.547874 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: WARNING keystonemiddleware.auth_token [None req-e72e6fac-0a10-42db-a141-c6a238b73293 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 11:31:53.555659 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: WARNING keystonemiddleware.auth_token [None req-771be2ba-4ee5-4173-98bf-0a9c55785bf7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 11:31:53.556678 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: WARNING keystonemiddleware.auth_token [None req-e72e6fac-0a10-42db-a141-c6a238b73293 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 11:31:53.562917 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: WARNING keystonemiddleware.auth_token [None req-771be2ba-4ee5-4173-98bf-0a9c55785bf7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 11:31:53.903107 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: WARNING keystonemiddleware.auth_token [None req-e72e6fac-0a10-42db-a141-c6a238b73293 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 11:31:53.909239 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: WARNING keystonemiddleware.auth_token [None req-e72e6fac-0a10-42db-a141-c6a238b73293 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 11:31:53.915506 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a2c3e399c0 pid: 124683 (default app) Aug 10 11:31:53.920834 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: WARNING keystonemiddleware.auth_token [None req-771be2ba-4ee5-4173-98bf-0a9c55785bf7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 11:31:53.928387 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: WARNING keystonemiddleware.auth_token [None req-771be2ba-4ee5-4173-98bf-0a9c55785bf7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 11:31:53.934786 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a2c3e399c0 pid: 124682 (default app) Aug 10 11:32:28.873228 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=3 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:32:28.874545 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=3 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:32:28.876228 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=3 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:32:28.876981 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=3 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:32:30.373169 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-63f336b6-cd87-4873-a067-13a8854807bf tempest-VolumesGetTestJSON-605002587 tempest-VolumesGetTestJSON-605002587-project] Action: 'create', calling method: .version_select at 0x7fb7cfd1edc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-173556305", "metadata": {"Type": "work"}}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:32:32.852918 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-63f336b6-cd87-4873-a067-13a8854807bf tempest-VolumesGetTestJSON-605002587 tempest-VolumesGetTestJSON-605002587-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.997318 Aug 10 11:32:32.864844 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 1/1] 10.222.0.62 () {60 vars in 1156 bytes} [Wed Aug 10 11:32:28 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 4011 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 10 11:32:33.197867 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-234b4cf7-faba-4f89-ae35-91621cc7a27b tempest-VolumesGetTestJSON-605002587 tempest-VolumesGetTestJSON-605002587-project] Calling method '.version_select at 0x7fb7cfdf7940>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:33.228896 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=3 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:32:33.230083 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=3 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:32:33.231546 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=3 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:32:33.232580 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=3 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:32:33.645107 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-234b4cf7-faba-4f89-ae35-91621cc7a27b tempest-VolumesGetTestJSON-605002587 tempest-VolumesGetTestJSON-605002587-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/19841a95-93d1-4ba1-98f9-32b14560db61" status: 200 len: 352 microversion: 2.1 time: 0.778018 Aug 10 11:32:33.645866 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 1/2] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Aug 10 11:32:32 2022] GET /compute/v2.1/os-volumes/19841a95-93d1-4ba1-98f9-32b14560db61 => generated 352 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:32:33.978076 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-3f49e57e-b939-435e-9e06-e1fdf064bac5 tempest-VolumesTestJSON-1826396125 tempest-VolumesTestJSON-1826396125-project] Calling method '.version_select at 0x7fb7cfc11c10>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:33.978076 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-3f49e57e-b939-435e-9e06-e1fdf064bac5 tempest-VolumesTestJSON-1826396125 tempest-VolumesTestJSON-1826396125-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/22fd8112-d6e6-4ce7-a6f9-dc9726d6cdaa" status: 200 len: 351 microversion: 2.1 time: 0.054314 Aug 10 11:32:33.978076 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 2/3] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Aug 10 11:32:33 2022] GET /compute/v2.1/os-volumes/22fd8112-d6e6-4ce7-a6f9-dc9726d6cdaa => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:32:34.669792 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-57e60122-1a45-4825-adbf-770be6c6f6b2 tempest-VolumesGetTestJSON-605002587 tempest-VolumesGetTestJSON-605002587-project] Calling method '.version_select at 0x7fb7cfc47e50>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:34.813026 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-57e60122-1a45-4825-adbf-770be6c6f6b2 tempest-VolumesGetTestJSON-605002587 tempest-VolumesGetTestJSON-605002587-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/19841a95-93d1-4ba1-98f9-32b14560db61" status: 200 len: 353 microversion: 2.1 time: 0.156930 Aug 10 11:32:34.814274 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 2/4] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Aug 10 11:32:34 2022] GET /compute/v2.1/os-volumes/19841a95-93d1-4ba1-98f9-32b14560db61 => generated 353 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:32:34.827432 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-907c426b-bc79-4bc7-bf58-349172265689 tempest-VolumesGetTestJSON-605002587 tempest-VolumesGetTestJSON-605002587-project] Calling method '.version_select at 0x7fb7cfbaf3a0>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:34.911985 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-907c426b-bc79-4bc7-bf58-349172265689 tempest-VolumesGetTestJSON-605002587 tempest-VolumesGetTestJSON-605002587-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/19841a95-93d1-4ba1-98f9-32b14560db61" status: 200 len: 353 microversion: 2.1 time: 0.089636 Aug 10 11:32:34.912653 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 3/5] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Aug 10 11:32:34 2022] GET /compute/v2.1/os-volumes/19841a95-93d1-4ba1-98f9-32b14560db61 => generated 353 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:32:34.927552 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-213f8dc4-340a-4ecf-b8fa-636983394004 tempest-VolumesGetTestJSON-605002587 tempest-VolumesGetTestJSON-605002587-project] Calling method '.version_select at 0x7fb7cfb963a0>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:35.394900 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-213f8dc4-340a-4ecf-b8fa-636983394004 tempest-VolumesGetTestJSON-605002587 tempest-VolumesGetTestJSON-605002587-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/19841a95-93d1-4ba1-98f9-32b14560db61" status: 202 len: 0 microversion: 2.1 time: 0.471938 Aug 10 11:32:35.395680 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 3/6] 10.222.0.62 () {58 vars in 1248 bytes} [Wed Aug 10 11:32:34 2022] DELETE /compute/v2.1/os-volumes/19841a95-93d1-4ba1-98f9-32b14560db61 => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:32:35.404649 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-23aa6f77-2c92-48bf-8c93-b41ca1e1ec29 tempest-VolumesGetTestJSON-605002587 tempest-VolumesGetTestJSON-605002587-project] Calling method '.version_select at 0x7fb7cfbafa60>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:35.534139 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-23aa6f77-2c92-48bf-8c93-b41ca1e1ec29 tempest-VolumesGetTestJSON-605002587 tempest-VolumesGetTestJSON-605002587-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/19841a95-93d1-4ba1-98f9-32b14560db61" status: 200 len: 352 microversion: 2.1 time: 0.133860 Aug 10 11:32:35.535468 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 4/7] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Aug 10 11:32:35 2022] GET /compute/v2.1/os-volumes/19841a95-93d1-4ba1-98f9-32b14560db61 => generated 352 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:32:35.928062 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-f1ea749f-e20e-4501-a605-bec3ac50bd84 tempest-VolumesTestJSON-1826396125 tempest-VolumesTestJSON-1826396125-project] Calling method '.version_select at 0x7fb7cfb96a60>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:36.011799 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-f1ea749f-e20e-4501-a605-bec3ac50bd84 tempest-VolumesTestJSON-1826396125 tempest-VolumesTestJSON-1826396125-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/037bb9a2-038b-496b-ab81-89fbe9a0bea5" status: 200 len: 350 microversion: 2.1 time: 0.088425 Aug 10 11:32:36.012406 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 4/8] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Aug 10 11:32:35 2022] GET /compute/v2.1/os-volumes/037bb9a2-038b-496b-ab81-89fbe9a0bea5 => generated 350 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:32:36.551240 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-5c18c430-5be1-457e-ba06-14bf57edc400 tempest-VolumesGetTestJSON-605002587 tempest-VolumesGetTestJSON-605002587-project] Calling method '.version_select at 0x7fb7cfc11ca0>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:36.690273 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-5c18c430-5be1-457e-ba06-14bf57edc400 tempest-VolumesGetTestJSON-605002587 tempest-VolumesGetTestJSON-605002587-project] HTTP exception thrown: Volume 19841a95-93d1-4ba1-98f9-32b14560db61 could not be found. Aug 10 11:32:36.695673 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-5c18c430-5be1-457e-ba06-14bf57edc400 tempest-VolumesGetTestJSON-605002587 tempest-VolumesGetTestJSON-605002587-project] Request method failure captured: Aug 10 11:32:36.695673 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: request: GET /compute/v2.1/os-volumes/19841a95-93d1-4ba1-98f9-32b14560db61 HTTP/1.1 Aug 10 11:32:36.695673 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept: application/json Aug 10 11:32:36.695673 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Aug 10 11:32:36.695673 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Connection: close Aug 10 11:32:36.695673 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Length: 0 Aug 10 11:32:36.695673 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Type: application/json Aug 10 11:32:36.695673 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Host: 10.222.0.62 Aug 10 11:32:36.695673 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Aug 10 11:32:36.695673 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.11 Aug 10 11:32:36.695673 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABi85dMQvxKPjVHjHgZpUH0lCtCQiUHpJy84rjMwOxndhz6LJGfKUiD_ZT-ClrxBk19GQXJBZ1fKnYw6lOR0t3-Bjx_jIIda7unn6MxMvwtLSJz7M854LthahTdnsQnu51iMm1EoDvxaj_2eL3RFQ7xw63nxB7t40z4At9zoFHyiNssPZM Aug 10 11:32:36.695673 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Aug 10 11:32:36.695673 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Aug 10 11:32:36.695673 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Aug 10 11:32:36.695673 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Aug 10 11:32:36.695673 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Aug 10 11:32:36.695673 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Aug 10 11:32:36.695673 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Id: 55ea447ca31e4ca8bc5a5bdcc54f4096 Aug 10 11:32:36.695673 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-VolumesGetTestJSON-605002587 Aug 10 11:32:36.695673 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Role: member,reader Aug 10 11:32:36.695673 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Aug 10 11:32:36.696997 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/55ea447ca31e4ca8bc5a5bdcc54f4096"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_55ea447ca31e4ca8bc5a5bdcc54f4096", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/55ea447ca31e4ca8bc5a5bdcc54f4096"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/55ea447ca31e4ca8bc5a5bdcc54f4096"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:32:36.696997 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-VolumesGetTestJSON-605002587 Aug 10 11:32:36.696997 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Id: 55ea447ca31e4ca8bc5a5bdcc54f4096 Aug 10 11:32:36.696997 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-VolumesGetTestJSON-605002587 Aug 10 11:32:36.696997 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User: tempest-VolumesGetTestJSON-605002587-project Aug 10 11:32:36.696997 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Aug 10 11:32:36.696997 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Aug 10 11:32:36.696997 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Id: 242f744f3758478faab3eb167e1a0bea Aug 10 11:32:36.696997 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-VolumesGetTestJSON-605002587-project Aug 10 11:32:36.696997 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: method: Aug 10 11:32:36.696997 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: exception: Volume 19841a95-93d1-4ba1-98f9-32b14560db61 could not be found. Aug 10 11:32:36.696997 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: action_args: {'id': '19841a95-93d1-4ba1-98f9-32b14560db61'} Aug 10 11:32:36.696997 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:32:36.697855 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:32:36.697855 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 11:32:36.697855 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 11:32:36.697855 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 11:32:36.697855 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 11:32:36.697855 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 11:32:36.697855 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 11:32:36.697855 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 11:32:36.697855 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 11:32:36.697855 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 11:32:36.697855 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 11:32:36.697855 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 11:32:36.697855 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 11:32:36.697855 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 11:32:36.697855 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 11:32:36.697855 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 19841a95-93d1-4ba1-98f9-32b14560db61 could not be found. (HTTP 404) (Request-ID: req-420a0d90-9f54-4198-b0fd-2ee65a1ee8c6) Aug 10 11:32:36.697855 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:32:36.697855 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:32:36.697855 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:32:36.698931 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:32:36.698931 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 11:32:36.698931 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 11:32:36.698931 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 11:32:36.698931 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 11:32:36.698931 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 11:32:36.698931 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 11:32:36.698931 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 11:32:36.698931 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 11:32:36.698931 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 11:32:36.698931 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 11:32:36.698931 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 11:32:36.698931 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 11:32:36.698931 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 11:32:36.698931 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 11:32:36.698931 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 11:32:36.698931 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 11:32:36.698931 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 11:32:36.698931 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 11:32:36.700027 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 11:32:36.700027 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 11:32:36.700027 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 11:32:36.700027 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 11:32:36.700027 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 19841a95-93d1-4ba1-98f9-32b14560db61 could not be found. Aug 10 11:32:36.700027 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:32:36.700027 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:32:36.700027 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:32:36.700027 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:32:36.700027 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:32:36.700027 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:32:36.700027 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:32:36.700027 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:32:36.700027 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 11:32:36.700027 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 11:32:36.700027 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:32:36.700027 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:32:36.700027 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 11:32:36.700027 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:32:36.701114 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 19841a95-93d1-4ba1-98f9-32b14560db61 could not be found. Aug 10 11:32:36.701114 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:32:36.701114 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:32:36.701114 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:32:36.701114 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:32:36.701114 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:32:36.701114 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:32:36.701114 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:32:36.701114 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:32:36.701114 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 19841a95-93d1-4ba1-98f9-32b14560db61 could not be found. Aug 10 11:32:36.701114 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:32:36.703179 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-5c18c430-5be1-457e-ba06-14bf57edc400 tempest-VolumesGetTestJSON-605002587 tempest-VolumesGetTestJSON-605002587-project] Returning 404 to user: Volume 19841a95-93d1-4ba1-98f9-32b14560db61 could not be found. {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:32:36.704769 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-5c18c430-5be1-457e-ba06-14bf57edc400 tempest-VolumesGetTestJSON-605002587 tempest-VolumesGetTestJSON-605002587-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/19841a95-93d1-4ba1-98f9-32b14560db61" status: 404 len: 109 microversion: 2.1 time: 0.159112 Aug 10 11:32:36.706168 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 5/9] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Aug 10 11:32:36 2022] GET /compute/v2.1/os-volumes/19841a95-93d1-4ba1-98f9-32b14560db61 => generated 109 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:32:38.263298 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-032506e5-259c-4548-8e62-d2a19674a2bb tempest-VolumesTestJSON-1826396125 tempest-VolumesTestJSON-1826396125-project] Calling method '.version_select at 0x7fb7cfba11f0>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:38.370729 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-032506e5-259c-4548-8e62-d2a19674a2bb tempest-VolumesTestJSON-1826396125 tempest-VolumesTestJSON-1826396125-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/ae499f82-5fd3-4db5-afe7-3d00ebf7f052" status: 200 len: 351 microversion: 2.1 time: 0.113450 Aug 10 11:32:38.371642 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 5/10] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Aug 10 11:32:38 2022] GET /compute/v2.1/os-volumes/ae499f82-5fd3-4db5-afe7-3d00ebf7f052 => generated 351 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:32:38.385882 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-2aa12f90-3f4d-4377-9271-ec1a88f8c955 tempest-VolumesTestJSON-1826396125 tempest-VolumesTestJSON-1826396125-project] Calling method '.version_select at 0x7fb7d05210d0>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:38.579677 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-2aa12f90-3f4d-4377-9271-ec1a88f8c955 tempest-VolumesTestJSON-1826396125 tempest-VolumesTestJSON-1826396125-project] 10.222.0.62 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.197832 Aug 10 11:32:38.580855 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 6/11] 10.222.0.62 () {58 vars in 1134 bytes} [Wed Aug 10 11:32:38 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:32:38.602159 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-d135d08f-536f-40b2-b084-6ffb398d46ad tempest-VolumesTestJSON-1826396125 tempest-VolumesTestJSON-1826396125-project] Calling method '.version_select at 0x7fb7cfc47e50>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:38.887264 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-d135d08f-536f-40b2-b084-6ffb398d46ad tempest-VolumesTestJSON-1826396125 tempest-VolumesTestJSON-1826396125-project] 10.222.0.62 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.290436 Aug 10 11:32:38.887264 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 6/12] 10.222.0.62 () {58 vars in 1149 bytes} [Wed Aug 10 11:32:38 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:32:38.897411 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-0607ca4e-e733-4a96-9359-0c098ed1159c tempest-VolumesTestJSON-1826396125 tempest-VolumesTestJSON-1826396125-project] Calling method '.version_select at 0x7fb7cfb7ff70>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:39.174768 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-0607ca4e-e733-4a96-9359-0c098ed1159c tempest-VolumesTestJSON-1826396125 tempest-VolumesTestJSON-1826396125-project] 10.222.0.62 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.280960 Aug 10 11:32:39.175437 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 7/13] 10.222.0.62 () {58 vars in 1134 bytes} [Wed Aug 10 11:32:38 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:32:39.188456 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-b4aca3d8-2e20-4e7d-9b38-f2a8f24b7f1f tempest-VolumesTestJSON-1826396125 tempest-VolumesTestJSON-1826396125-project] Calling method '.version_select at 0x7fb7cfc47af0>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:39.381241 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-b4aca3d8-2e20-4e7d-9b38-f2a8f24b7f1f tempest-VolumesTestJSON-1826396125 tempest-VolumesTestJSON-1826396125-project] 10.222.0.62 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.196985 Aug 10 11:32:39.383672 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 7/14] 10.222.0.62 () {58 vars in 1167 bytes} [Wed Aug 10 11:32:39 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:32:39.397204 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-cba18308-83e4-466b-a154-b867f724f9b9 tempest-VolumesTestJSON-1826396125 tempest-VolumesTestJSON-1826396125-project] Calling method '.version_select at 0x7fb7cfb1f160>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:39.554974 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-cba18308-83e4-466b-a154-b867f724f9b9 tempest-VolumesTestJSON-1826396125 tempest-VolumesTestJSON-1826396125-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.161427 Aug 10 11:32:39.555548 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 8/15] 10.222.0.62 () {58 vars in 1170 bytes} [Wed Aug 10 11:32:39 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:32:39.571476 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-82fa1bd3-9188-4cbe-bbee-87b7ddd0b516 tempest-VolumesTestJSON-1826396125 tempest-VolumesTestJSON-1826396125-project] Calling method '.version_select at 0x7fb7cfba1f70>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:39.716025 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-82fa1bd3-9188-4cbe-bbee-87b7ddd0b516 tempest-VolumesTestJSON-1826396125 tempest-VolumesTestJSON-1826396125-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.148851 Aug 10 11:32:39.716537 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 8/16] 10.222.0.62 () {58 vars in 1155 bytes} [Wed Aug 10 11:32:39 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:32:39.729675 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-5566aa76-0c64-40b9-a917-d80768835d68 tempest-VolumesTestJSON-1826396125 tempest-VolumesTestJSON-1826396125-project] Calling method '.version_select at 0x7fb7cfb1fa60>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:39.902890 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-5566aa76-0c64-40b9-a917-d80768835d68 tempest-VolumesTestJSON-1826396125 tempest-VolumesTestJSON-1826396125-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.176826 Aug 10 11:32:39.904527 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 9/17] 10.222.0.62 () {58 vars in 1188 bytes} [Wed Aug 10 11:32:39 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:32:39.925652 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-a58940b7-d5f9-4042-84eb-6341cda44c9e tempest-VolumesTestJSON-1826396125 tempest-VolumesTestJSON-1826396125-project] Calling method '.version_select at 0x7fb7cfbb71f0>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:40.106890 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-a58940b7-d5f9-4042-84eb-6341cda44c9e tempest-VolumesTestJSON-1826396125 tempest-VolumesTestJSON-1826396125-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.191262 Aug 10 11:32:40.107571 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 9/18] 10.222.0.62 () {58 vars in 1155 bytes} [Wed Aug 10 11:32:39 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:32:43.016735 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-64eb5cbf-7d15-408c-95f5-62048e2e791b tempest-VolumesNegativeTest-25303028 tempest-VolumesNegativeTest-25303028-project] Action: 'create', calling method: .version_select at 0x7fb7cfb1a670>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1004381915", "metadata": {"Type": "work"}}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:32:43.022027 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-64eb5cbf-7d15-408c-95f5-62048e2e791b tempest-VolumesNegativeTest-25303028 tempest-VolumesNegativeTest-25303028-project] Request method failure captured: Aug 10 11:32:43.022027 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 10 11:32:43.022027 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept: application/json Aug 10 11:32:43.022027 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Aug 10 11:32:43.022027 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Connection: close Aug 10 11:32:43.022027 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Length: 122 Aug 10 11:32:43.022027 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Type: application/json Aug 10 11:32:43.022027 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Host: 10.222.0.62 Aug 10 11:32:43.022027 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Aug 10 11:32:43.022027 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.11 Aug 10 11:32:43.022027 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABi85daqd4DaZ8h-dNk1gcWy_7WAIqd10_y4gdKjD0-D4udu0-xMsCjXG-Ifv6Yvr1I5ppiNRDs8-4D2Vt4rFHusqde5sqH-B5PGO3VAxbErwRF-pP74OjKxIMOyYhMQlhV0X9nyV20MeHdgclEkvnAR1FMj9EDEgRI1_hp_LmHfU_3XHU Aug 10 11:32:43.022027 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Aug 10 11:32:43.022027 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Aug 10 11:32:43.022027 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Aug 10 11:32:43.022027 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Aug 10 11:32:43.022027 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Aug 10 11:32:43.022027 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Aug 10 11:32:43.022027 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Id: c63e31b7c8144f9aa8e068beac61ad4e Aug 10 11:32:43.022027 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-VolumesNegativeTest-25303028 Aug 10 11:32:43.022027 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Role: member,reader Aug 10 11:32:43.022027 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Aug 10 11:32:43.023248 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c63e31b7c8144f9aa8e068beac61ad4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c63e31b7c8144f9aa8e068beac61ad4e", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c63e31b7c8144f9aa8e068beac61ad4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c63e31b7c8144f9aa8e068beac61ad4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:32:43.023248 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-VolumesNegativeTest-25303028 Aug 10 11:32:43.023248 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Id: c63e31b7c8144f9aa8e068beac61ad4e Aug 10 11:32:43.023248 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-VolumesNegativeTest-25303028 Aug 10 11:32:43.023248 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User: tempest-VolumesNegativeTest-25303028-project Aug 10 11:32:43.023248 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Aug 10 11:32:43.023248 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Aug 10 11:32:43.023248 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Id: ed1db6bfefa44818b585a23ae17e176a Aug 10 11:32:43.023248 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-VolumesNegativeTest-25303028-project Aug 10 11:32:43.023248 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Aug 10 11:32:43.023248 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1004381915", "metadata": {"Type": "work"}}} Aug 10 11:32:43.023248 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: method: Aug 10 11:32:43.023248 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 10 11:32:43.036954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1004381915', 'metadata': {'Type': 'work'}}}} Aug 10 11:32:43.036954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:32:43.036954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:32:43.036954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 11:32:43.036954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 11:32:43.036954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 11:32:43.036954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise error Aug 10 11:32:43.036954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 10 11:32:43.036954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:32:43.036954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 10 11:32:43.036954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 10 11:32:43.036954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:32:43.036954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 10 11:32:43.036954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi '#$%' Aug 10 11:32:43.036954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:32:43.036954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:32:43.036954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:32:43.036954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:32:43.036954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:32:43.036954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:32:43.036954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:32:43.036954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:32:43.039023 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 11:32:43.039023 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 11:32:43.039023 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:32:43.039023 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:32:43.039023 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 11:32:43.039023 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 11:32:43.039023 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 11:32:43.039023 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 11:32:43.039023 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 11:32:43.039023 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 11:32:43.039023 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 10 11:32:43.039023 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:32:43.039023 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:32:43.039023 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:32:43.039023 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:32:43.039023 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:32:43.039023 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:32:43.039023 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 11:32:43.039023 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 11:32:43.041284 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 10 11:32:43.041284 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:32:43.041284 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-64eb5cbf-7d15-408c-95f5-62048e2e791b tempest-VolumesNegativeTest-25303028 tempest-VolumesNegativeTest-25303028-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:32:43.051284 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-64eb5cbf-7d15-408c-95f5-62048e2e791b tempest-VolumesNegativeTest-25303028 tempest-VolumesNegativeTest-25303028-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.261543 Aug 10 11:32:43.055719 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 10/19] 10.222.0.62 () {60 vars in 1156 bytes} [Wed Aug 10 11:32:42 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 267 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 11:32:43.063704 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-8fed50af-dd9d-4eed-9d65-737797fe213a tempest-VolumesNegativeTest-25303028 tempest-VolumesNegativeTest-25303028-project] Action: 'create', calling method: .version_select at 0x7fb7cfbad040>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2108362324", "metadata": {"Type": "work"}}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:32:43.072496 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-8fed50af-dd9d-4eed-9d65-737797fe213a tempest-VolumesNegativeTest-25303028 tempest-VolumesNegativeTest-25303028-project] Request method failure captured: Aug 10 11:32:43.072496 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 10 11:32:43.072496 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Accept: application/json Aug 10 11:32:43.072496 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Aug 10 11:32:43.072496 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Connection: close Aug 10 11:32:43.072496 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Content-Length: 120 Aug 10 11:32:43.072496 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Content-Type: application/json Aug 10 11:32:43.072496 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Host: 10.222.0.62 Aug 10 11:32:43.072496 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Aug 10 11:32:43.072496 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.11 Aug 10 11:32:43.072496 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABi85daqd4DaZ8h-dNk1gcWy_7WAIqd10_y4gdKjD0-D4udu0-xMsCjXG-Ifv6Yvr1I5ppiNRDs8-4D2Vt4rFHusqde5sqH-B5PGO3VAxbErwRF-pP74OjKxIMOyYhMQlhV0X9nyV20MeHdgclEkvnAR1FMj9EDEgRI1_hp_LmHfU_3XHU Aug 10 11:32:43.072496 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Aug 10 11:32:43.072496 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Aug 10 11:32:43.072496 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Aug 10 11:32:43.072496 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Aug 10 11:32:43.072496 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Aug 10 11:32:43.072496 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Aug 10 11:32:43.072496 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Id: c63e31b7c8144f9aa8e068beac61ad4e Aug 10 11:32:43.072496 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-VolumesNegativeTest-25303028 Aug 10 11:32:43.072496 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Role: member,reader Aug 10 11:32:43.072496 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Aug 10 11:32:43.073880 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c63e31b7c8144f9aa8e068beac61ad4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c63e31b7c8144f9aa8e068beac61ad4e", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c63e31b7c8144f9aa8e068beac61ad4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c63e31b7c8144f9aa8e068beac61ad4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:32:43.073880 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-VolumesNegativeTest-25303028 Aug 10 11:32:43.073880 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant-Id: c63e31b7c8144f9aa8e068beac61ad4e Aug 10 11:32:43.073880 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-VolumesNegativeTest-25303028 Aug 10 11:32:43.073880 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User: tempest-VolumesNegativeTest-25303028-project Aug 10 11:32:43.073880 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Aug 10 11:32:43.073880 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Aug 10 11:32:43.073880 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Id: ed1db6bfefa44818b585a23ae17e176a Aug 10 11:32:43.073880 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-VolumesNegativeTest-25303028-project Aug 10 11:32:43.073880 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Aug 10 11:32:43.073880 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2108362324", "metadata": {"Type": "work"}}} Aug 10 11:32:43.073880 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: method: Aug 10 11:32:43.073880 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 10 11:32:43.074645 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2108362324', 'metadata': {'Type': 'work'}}}} Aug 10 11:32:43.074645 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:32:43.074645 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:32:43.074645 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 11:32:43.074645 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 11:32:43.074645 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 11:32:43.074645 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise error Aug 10 11:32:43.074645 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 10 11:32:43.074645 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:32:43.074645 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 10 11:32:43.074645 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 10 11:32:43.074645 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:32:43.074645 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 10 11:32:43.074645 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi '0' Aug 10 11:32:43.074645 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:32:43.074645 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:32:43.074645 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:32:43.074645 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:32:43.074645 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:32:43.074645 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:32:43.074645 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:32:43.074645 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:32:43.077857 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 11:32:43.077857 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 11:32:43.077857 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:32:43.077857 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:32:43.077857 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 11:32:43.077857 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 11:32:43.077857 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 11:32:43.077857 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 11:32:43.077857 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 11:32:43.077857 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 11:32:43.077857 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 10 11:32:43.077857 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:32:43.077857 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:32:43.077857 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:32:43.077857 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:32:43.077857 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:32:43.077857 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:32:43.077857 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 11:32:43.077857 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 11:32:43.079172 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 10 11:32:43.079172 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:32:43.082334 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-8fed50af-dd9d-4eed-9d65-737797fe213a tempest-VolumesNegativeTest-25303028 tempest-VolumesNegativeTest-25303028-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:32:43.089894 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-8fed50af-dd9d-4eed-9d65-737797fe213a tempest-VolumesNegativeTest-25303028 tempest-VolumesNegativeTest-25303028-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.029278 Aug 10 11:32:43.091266 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 10/20] 10.222.0.62 () {60 vars in 1156 bytes} [Wed Aug 10 11:32:43 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 11:32:43.158311 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-a90fb5ed-a0a8-4239-a6c7-5bb0eddce3dc tempest-VolumesNegativeTest-25303028 tempest-VolumesNegativeTest-25303028-project] Action: 'create', calling method: .version_select at 0x7fb7cfb7f670>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-817707180", "metadata": {"Type": "work"}}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:32:43.193617 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-a90fb5ed-a0a8-4239-a6c7-5bb0eddce3dc tempest-VolumesNegativeTest-25303028 tempest-VolumesNegativeTest-25303028-project] Request method failure captured: Aug 10 11:32:43.193617 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 10 11:32:43.193617 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept: application/json Aug 10 11:32:43.193617 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Aug 10 11:32:43.193617 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Connection: close Aug 10 11:32:43.193617 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Length: 118 Aug 10 11:32:43.193617 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Type: application/json Aug 10 11:32:43.193617 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Host: 10.222.0.62 Aug 10 11:32:43.193617 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Aug 10 11:32:43.193617 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.11 Aug 10 11:32:43.193617 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABi85daqd4DaZ8h-dNk1gcWy_7WAIqd10_y4gdKjD0-D4udu0-xMsCjXG-Ifv6Yvr1I5ppiNRDs8-4D2Vt4rFHusqde5sqH-B5PGO3VAxbErwRF-pP74OjKxIMOyYhMQlhV0X9nyV20MeHdgclEkvnAR1FMj9EDEgRI1_hp_LmHfU_3XHU Aug 10 11:32:43.193617 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Aug 10 11:32:43.193617 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Aug 10 11:32:43.193617 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Aug 10 11:32:43.193617 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Aug 10 11:32:43.193617 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Aug 10 11:32:43.193617 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Aug 10 11:32:43.193617 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Id: c63e31b7c8144f9aa8e068beac61ad4e Aug 10 11:32:43.193617 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-VolumesNegativeTest-25303028 Aug 10 11:32:43.193617 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Role: member,reader Aug 10 11:32:43.193617 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Aug 10 11:32:43.194744 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c63e31b7c8144f9aa8e068beac61ad4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c63e31b7c8144f9aa8e068beac61ad4e", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c63e31b7c8144f9aa8e068beac61ad4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c63e31b7c8144f9aa8e068beac61ad4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:32:43.194744 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-VolumesNegativeTest-25303028 Aug 10 11:32:43.194744 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Id: c63e31b7c8144f9aa8e068beac61ad4e Aug 10 11:32:43.194744 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-VolumesNegativeTest-25303028 Aug 10 11:32:43.194744 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User: tempest-VolumesNegativeTest-25303028-project Aug 10 11:32:43.194744 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Aug 10 11:32:43.194744 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Aug 10 11:32:43.194744 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Id: ed1db6bfefa44818b585a23ae17e176a Aug 10 11:32:43.194744 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-VolumesNegativeTest-25303028-project Aug 10 11:32:43.194744 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Aug 10 11:32:43.194744 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-817707180", "metadata": {"Type": "work"}}} Aug 10 11:32:43.194744 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: method: Aug 10 11:32:43.194744 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 10 11:32:43.195393 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-817707180', 'metadata': {'Type': 'work'}}}} Aug 10 11:32:43.195393 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:32:43.195393 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:32:43.195393 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 11:32:43.195393 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 11:32:43.195393 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 11:32:43.195393 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise error Aug 10 11:32:43.195393 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 10 11:32:43.195393 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:32:43.195393 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 10 11:32:43.195393 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 10 11:32:43.195393 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:32:43.195393 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 10 11:32:43.195393 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi '' Aug 10 11:32:43.195393 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:32:43.195393 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:32:43.195393 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:32:43.195393 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:32:43.195393 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:32:43.195393 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:32:43.195393 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:32:43.195393 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:32:43.196513 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 11:32:43.196513 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 11:32:43.196513 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:32:43.196513 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:32:43.196513 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 11:32:43.196513 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 11:32:43.196513 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 11:32:43.196513 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 11:32:43.196513 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 11:32:43.196513 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 11:32:43.196513 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 10 11:32:43.196513 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:32:43.196513 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:32:43.196513 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:32:43.196513 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:32:43.196513 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:32:43.196513 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:32:43.196513 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 11:32:43.196513 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 11:32:43.197414 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 10 11:32:43.197414 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:32:43.197414 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-a90fb5ed-a0a8-4239-a6c7-5bb0eddce3dc tempest-VolumesNegativeTest-25303028 tempest-VolumesNegativeTest-25303028-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:32:43.197414 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-a90fb5ed-a0a8-4239-a6c7-5bb0eddce3dc tempest-VolumesNegativeTest-25303028 tempest-VolumesNegativeTest-25303028-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.096816 Aug 10 11:32:43.205577 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 11/21] 10.222.0.62 () {60 vars in 1156 bytes} [Wed Aug 10 11:32:43 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 11:32:43.221141 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-5134fc90-21d7-4873-8729-df7fa993f57b tempest-VolumesNegativeTest-25303028 tempest-VolumesNegativeTest-25303028-project] Calling method '.version_select at 0x7fb7cfbb70d0>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:43.277036 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.wsgi [None req-5134fc90-21d7-4873-8729-df7fa993f57b tempest-VolumesNegativeTest-25303028 tempest-VolumesNegativeTest-25303028-project] HTTP exception thrown: Volume tempest-invalid-698658895 could not be found. Aug 10 11:32:43.283041 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-5134fc90-21d7-4873-8729-df7fa993f57b tempest-VolumesNegativeTest-25303028 tempest-VolumesNegativeTest-25303028-project] Request method failure captured: Aug 10 11:32:43.283041 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-698658895 HTTP/1.1 Aug 10 11:32:43.283041 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Accept: application/json Aug 10 11:32:43.283041 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Aug 10 11:32:43.283041 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Connection: close Aug 10 11:32:43.283041 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Content-Length: 0 Aug 10 11:32:43.283041 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Content-Type: application/json Aug 10 11:32:43.283041 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Host: 10.222.0.62 Aug 10 11:32:43.283041 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Aug 10 11:32:43.283041 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.11 Aug 10 11:32:43.283041 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABi85daqd4DaZ8h-dNk1gcWy_7WAIqd10_y4gdKjD0-D4udu0-xMsCjXG-Ifv6Yvr1I5ppiNRDs8-4D2Vt4rFHusqde5sqH-B5PGO3VAxbErwRF-pP74OjKxIMOyYhMQlhV0X9nyV20MeHdgclEkvnAR1FMj9EDEgRI1_hp_LmHfU_3XHU Aug 10 11:32:43.283041 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Aug 10 11:32:43.283041 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Aug 10 11:32:43.283041 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Aug 10 11:32:43.283041 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Aug 10 11:32:43.283041 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Aug 10 11:32:43.283041 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Aug 10 11:32:43.283041 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Id: c63e31b7c8144f9aa8e068beac61ad4e Aug 10 11:32:43.283041 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-VolumesNegativeTest-25303028 Aug 10 11:32:43.283041 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Role: member,reader Aug 10 11:32:43.283041 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Aug 10 11:32:43.284354 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c63e31b7c8144f9aa8e068beac61ad4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c63e31b7c8144f9aa8e068beac61ad4e", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c63e31b7c8144f9aa8e068beac61ad4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c63e31b7c8144f9aa8e068beac61ad4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:32:43.284354 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-VolumesNegativeTest-25303028 Aug 10 11:32:43.284354 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant-Id: c63e31b7c8144f9aa8e068beac61ad4e Aug 10 11:32:43.284354 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-VolumesNegativeTest-25303028 Aug 10 11:32:43.284354 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User: tempest-VolumesNegativeTest-25303028-project Aug 10 11:32:43.284354 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Aug 10 11:32:43.284354 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Aug 10 11:32:43.284354 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Id: ed1db6bfefa44818b585a23ae17e176a Aug 10 11:32:43.284354 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-VolumesNegativeTest-25303028-project Aug 10 11:32:43.284354 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: method: Aug 10 11:32:43.284354 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: exception: Volume tempest-invalid-698658895 could not be found. Aug 10 11:32:43.284354 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: action_args: {'id': 'tempest-invalid-698658895'} Aug 10 11:32:43.284354 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:32:43.285057 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:32:43.285057 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 11:32:43.285057 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 11:32:43.285057 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 11:32:43.285057 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 11:32:43.285057 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 11:32:43.285057 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 11:32:43.285057 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 11:32:43.285057 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 11:32:43.285057 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 11:32:43.285057 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 11:32:43.285057 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 11:32:43.285057 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 11:32:43.285057 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 11:32:43.285057 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 11:32:43.285057 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-698658895 could not be found. (HTTP 404) (Request-ID: req-11442bb1-f7c7-4b38-8ff5-436ac2d1e587) Aug 10 11:32:43.285057 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:32:43.285057 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:32:43.285057 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:32:43.286201 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:32:43.286201 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 10 11:32:43.286201 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 10 11:32:43.286201 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 11:32:43.286201 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 11:32:43.286201 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 11:32:43.286201 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 11:32:43.286201 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 11:32:43.286201 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 11:32:43.286201 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 11:32:43.286201 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 11:32:43.286201 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 11:32:43.286201 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 11:32:43.286201 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 11:32:43.286201 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 11:32:43.286201 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 11:32:43.286201 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 11:32:43.286201 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 11:32:43.286201 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 11:32:43.287278 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 11:32:43.287278 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 11:32:43.287278 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 11:32:43.287278 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 11:32:43.287278 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-698658895 could not be found. Aug 10 11:32:43.287278 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:32:43.287278 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:32:43.287278 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:32:43.287278 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:32:43.287278 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:32:43.287278 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:32:43.287278 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:32:43.287278 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:32:43.287278 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 11:32:43.287278 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 11:32:43.287278 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:32:43.287278 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:32:43.287278 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 10 11:32:43.287278 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:32:43.287278 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-698658895 could not be found. Aug 10 11:32:43.288771 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:32:43.288771 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:32:43.288771 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:32:43.288771 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:32:43.288771 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:32:43.288771 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:32:43.288771 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:32:43.288771 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:32:43.288771 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-698658895 could not be found. Aug 10 11:32:43.288771 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:32:43.289576 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-5134fc90-21d7-4873-8729-df7fa993f57b tempest-VolumesNegativeTest-25303028 tempest-VolumesNegativeTest-25303028-project] Returning 404 to user: Volume tempest-invalid-698658895 could not be found. {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:32:43.291830 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-5134fc90-21d7-4873-8729-df7fa993f57b tempest-VolumesNegativeTest-25303028 tempest-VolumesNegativeTest-25303028-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/tempest-invalid-698658895" status: 404 len: 98 microversion: 2.1 time: 0.077668 Aug 10 11:32:43.298489 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 11/22] 10.222.0.62 () {58 vars in 1215 bytes} [Wed Aug 10 11:32:43 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-698658895 => generated 98 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 11:32:43.307685 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-2f726f9c-8504-4228-a418-c76870a86171 tempest-VolumesNegativeTest-25303028 tempest-VolumesNegativeTest-25303028-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004344 Aug 10 11:32:43.307685 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 12/23] 10.222.0.62 () {58 vars in 1140 bytes} [Wed Aug 10 11:32:43 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 10 11:32:43.313255 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-45b83b77-88c4-4615-903c-e1ee0f9ff7a2 tempest-VolumesNegativeTest-25303028 tempest-VolumesNegativeTest-25303028-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004413 Aug 10 11:32:43.314434 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 12/24] 10.222.0.62 () {58 vars in 1137 bytes} [Wed Aug 10 11:32:43 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 10 11:32:43.324502 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-4929864e-bf56-4bec-8355-09d3255fa84c tempest-VolumesNegativeTest-25303028 tempest-VolumesNegativeTest-25303028-project] Calling method '.version_select at 0x7fb7cfb1fe50>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:43.383871 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-4929864e-bf56-4bec-8355-09d3255fa84c tempest-VolumesNegativeTest-25303028 tempest-VolumesNegativeTest-25303028-project] HTTP exception thrown: Volume 42c66069-5cbd-438b-a8c0-5a3e0166e31e could not be found. Aug 10 11:32:43.387223 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-4929864e-bf56-4bec-8355-09d3255fa84c tempest-VolumesNegativeTest-25303028 tempest-VolumesNegativeTest-25303028-project] Request method failure captured: Aug 10 11:32:43.387223 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: request: DELETE /compute/v2.1/os-volumes/42c66069-5cbd-438b-a8c0-5a3e0166e31e HTTP/1.1 Aug 10 11:32:43.387223 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept: application/json Aug 10 11:32:43.387223 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Aug 10 11:32:43.387223 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Connection: close Aug 10 11:32:43.387223 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Length: 0 Aug 10 11:32:43.387223 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Type: application/json Aug 10 11:32:43.387223 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Host: 10.222.0.62 Aug 10 11:32:43.387223 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Aug 10 11:32:43.387223 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.11 Aug 10 11:32:43.387223 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABi85daqd4DaZ8h-dNk1gcWy_7WAIqd10_y4gdKjD0-D4udu0-xMsCjXG-Ifv6Yvr1I5ppiNRDs8-4D2Vt4rFHusqde5sqH-B5PGO3VAxbErwRF-pP74OjKxIMOyYhMQlhV0X9nyV20MeHdgclEkvnAR1FMj9EDEgRI1_hp_LmHfU_3XHU Aug 10 11:32:43.387223 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Aug 10 11:32:43.387223 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Aug 10 11:32:43.387223 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Aug 10 11:32:43.387223 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Aug 10 11:32:43.387223 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Aug 10 11:32:43.387223 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Aug 10 11:32:43.387223 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Id: c63e31b7c8144f9aa8e068beac61ad4e Aug 10 11:32:43.387223 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-VolumesNegativeTest-25303028 Aug 10 11:32:43.387223 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Role: member,reader Aug 10 11:32:43.387223 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Aug 10 11:32:43.388453 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c63e31b7c8144f9aa8e068beac61ad4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c63e31b7c8144f9aa8e068beac61ad4e", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c63e31b7c8144f9aa8e068beac61ad4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c63e31b7c8144f9aa8e068beac61ad4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:32:43.388453 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-VolumesNegativeTest-25303028 Aug 10 11:32:43.388453 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Id: c63e31b7c8144f9aa8e068beac61ad4e Aug 10 11:32:43.388453 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-VolumesNegativeTest-25303028 Aug 10 11:32:43.388453 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User: tempest-VolumesNegativeTest-25303028-project Aug 10 11:32:43.388453 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Aug 10 11:32:43.388453 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Aug 10 11:32:43.388453 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Id: ed1db6bfefa44818b585a23ae17e176a Aug 10 11:32:43.388453 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-VolumesNegativeTest-25303028-project Aug 10 11:32:43.388453 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: method: Aug 10 11:32:43.388453 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: exception: Volume 42c66069-5cbd-438b-a8c0-5a3e0166e31e could not be found. Aug 10 11:32:43.388453 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: action_args: {'id': '42c66069-5cbd-438b-a8c0-5a3e0166e31e'} Aug 10 11:32:43.388453 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:32:43.389544 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:32:43.389544 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 11:32:43.389544 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 11:32:43.389544 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 11:32:43.389544 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 11:32:43.389544 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 11:32:43.389544 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 11:32:43.389544 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 11:32:43.389544 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 11:32:43.389544 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 11:32:43.389544 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 11:32:43.389544 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 11:32:43.389544 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 11:32:43.389544 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 11:32:43.389544 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 11:32:43.389544 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 42c66069-5cbd-438b-a8c0-5a3e0166e31e could not be found. (HTTP 404) (Request-ID: req-136906df-6260-445c-8594-146b30e5843c) Aug 10 11:32:43.389544 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:32:43.389544 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:32:43.389544 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:32:43.391244 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:32:43.391244 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 10 11:32:43.391244 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 10 11:32:43.391244 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 11:32:43.391244 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 11:32:43.391244 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 11:32:43.391244 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 11:32:43.391244 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 11:32:43.391244 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 11:32:43.391244 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 11:32:43.391244 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 11:32:43.391244 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 11:32:43.391244 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 11:32:43.391244 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 11:32:43.391244 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 11:32:43.391244 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 11:32:43.391244 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 11:32:43.391244 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 11:32:43.391244 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 11:32:43.392442 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 11:32:43.392442 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 11:32:43.392442 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 11:32:43.392442 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 11:32:43.392442 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 42c66069-5cbd-438b-a8c0-5a3e0166e31e could not be found. Aug 10 11:32:43.392442 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:32:43.392442 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:32:43.392442 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:32:43.392442 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:32:43.392442 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:32:43.392442 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:32:43.392442 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:32:43.392442 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:32:43.392442 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 11:32:43.392442 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 11:32:43.392442 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:32:43.392442 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:32:43.392442 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 10 11:32:43.392442 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:32:43.393403 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 42c66069-5cbd-438b-a8c0-5a3e0166e31e could not be found. Aug 10 11:32:43.393403 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:32:43.393403 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:32:43.393403 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:32:43.393403 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:32:43.393403 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:32:43.393403 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:32:43.393403 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:32:43.393403 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:32:43.393403 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 42c66069-5cbd-438b-a8c0-5a3e0166e31e could not be found. Aug 10 11:32:43.393403 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:32:43.395350 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-4929864e-bf56-4bec-8355-09d3255fa84c tempest-VolumesNegativeTest-25303028 tempest-VolumesNegativeTest-25303028-project] Returning 404 to user: Volume 42c66069-5cbd-438b-a8c0-5a3e0166e31e could not be found. {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:32:43.396573 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-4929864e-bf56-4bec-8355-09d3255fa84c tempest-VolumesNegativeTest-25303028 tempest-VolumesNegativeTest-25303028-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/42c66069-5cbd-438b-a8c0-5a3e0166e31e" status: 404 len: 109 microversion: 2.1 time: 0.077225 Aug 10 11:32:43.401468 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 13/25] 10.222.0.62 () {58 vars in 1248 bytes} [Wed Aug 10 11:32:43 2022] DELETE /compute/v2.1/os-volumes/42c66069-5cbd-438b-a8c0-5a3e0166e31e => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:32:43.407055 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-737e082f-eac4-427a-bb80-5800fdfc46a1 tempest-VolumesNegativeTest-25303028 tempest-VolumesNegativeTest-25303028-project] Calling method '.version_select at 0x7fb7cfbb7790>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:43.439588 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.wsgi [None req-737e082f-eac4-427a-bb80-5800fdfc46a1 tempest-VolumesNegativeTest-25303028 tempest-VolumesNegativeTest-25303028-project] HTTP exception thrown: Volume 94569190-57da-4623-91c3-3b6e4cff117b could not be found. Aug 10 11:32:43.443730 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-737e082f-eac4-427a-bb80-5800fdfc46a1 tempest-VolumesNegativeTest-25303028 tempest-VolumesNegativeTest-25303028-project] Request method failure captured: Aug 10 11:32:43.443730 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: request: GET /compute/v2.1/os-volumes/94569190-57da-4623-91c3-3b6e4cff117b HTTP/1.1 Aug 10 11:32:43.443730 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Accept: application/json Aug 10 11:32:43.443730 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Aug 10 11:32:43.443730 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Connection: close Aug 10 11:32:43.443730 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Content-Length: 0 Aug 10 11:32:43.443730 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Content-Type: application/json Aug 10 11:32:43.443730 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Host: 10.222.0.62 Aug 10 11:32:43.443730 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Aug 10 11:32:43.443730 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.11 Aug 10 11:32:43.443730 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABi85daqd4DaZ8h-dNk1gcWy_7WAIqd10_y4gdKjD0-D4udu0-xMsCjXG-Ifv6Yvr1I5ppiNRDs8-4D2Vt4rFHusqde5sqH-B5PGO3VAxbErwRF-pP74OjKxIMOyYhMQlhV0X9nyV20MeHdgclEkvnAR1FMj9EDEgRI1_hp_LmHfU_3XHU Aug 10 11:32:43.443730 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Aug 10 11:32:43.443730 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Aug 10 11:32:43.443730 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Aug 10 11:32:43.443730 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Aug 10 11:32:43.443730 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Aug 10 11:32:43.443730 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Aug 10 11:32:43.443730 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Id: c63e31b7c8144f9aa8e068beac61ad4e Aug 10 11:32:43.443730 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-VolumesNegativeTest-25303028 Aug 10 11:32:43.443730 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Role: member,reader Aug 10 11:32:43.443730 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Aug 10 11:32:43.444883 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c63e31b7c8144f9aa8e068beac61ad4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c63e31b7c8144f9aa8e068beac61ad4e", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c63e31b7c8144f9aa8e068beac61ad4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c63e31b7c8144f9aa8e068beac61ad4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:32:43.444883 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-VolumesNegativeTest-25303028 Aug 10 11:32:43.444883 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant-Id: c63e31b7c8144f9aa8e068beac61ad4e Aug 10 11:32:43.444883 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-VolumesNegativeTest-25303028 Aug 10 11:32:43.444883 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User: tempest-VolumesNegativeTest-25303028-project Aug 10 11:32:43.444883 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Aug 10 11:32:43.444883 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Aug 10 11:32:43.444883 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Id: ed1db6bfefa44818b585a23ae17e176a Aug 10 11:32:43.444883 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-VolumesNegativeTest-25303028-project Aug 10 11:32:43.444883 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: method: Aug 10 11:32:43.444883 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: exception: Volume 94569190-57da-4623-91c3-3b6e4cff117b could not be found. Aug 10 11:32:43.444883 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: action_args: {'id': '94569190-57da-4623-91c3-3b6e4cff117b'} Aug 10 11:32:43.444883 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:32:43.445572 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:32:43.445572 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 11:32:43.445572 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 11:32:43.445572 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 11:32:43.445572 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 11:32:43.445572 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 11:32:43.445572 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 11:32:43.445572 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 11:32:43.445572 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 11:32:43.445572 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 11:32:43.445572 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 11:32:43.445572 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 11:32:43.445572 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 11:32:43.445572 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 11:32:43.445572 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 11:32:43.445572 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 94569190-57da-4623-91c3-3b6e4cff117b could not be found. (HTTP 404) (Request-ID: req-271d405a-f129-4e87-908e-6ed0a72f06a0) Aug 10 11:32:43.445572 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:32:43.445572 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:32:43.445572 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:32:43.446559 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:32:43.446559 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 11:32:43.446559 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 11:32:43.446559 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 11:32:43.446559 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 11:32:43.446559 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 11:32:43.446559 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 11:32:43.446559 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 11:32:43.446559 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 11:32:43.446559 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 11:32:43.446559 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 11:32:43.446559 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 11:32:43.446559 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 11:32:43.446559 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 11:32:43.446559 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 11:32:43.446559 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 11:32:43.446559 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 11:32:43.446559 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 11:32:43.446559 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 11:32:43.447494 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 11:32:43.447494 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 11:32:43.447494 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 11:32:43.447494 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 11:32:43.447494 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 94569190-57da-4623-91c3-3b6e4cff117b could not be found. Aug 10 11:32:43.447494 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:32:43.447494 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:32:43.447494 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:32:43.447494 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:32:43.447494 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:32:43.447494 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:32:43.447494 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:32:43.447494 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:32:43.447494 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 11:32:43.447494 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 11:32:43.447494 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:32:43.447494 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:32:43.447494 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 11:32:43.447494 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:32:43.448657 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 94569190-57da-4623-91c3-3b6e4cff117b could not be found. Aug 10 11:32:43.448657 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:32:43.448657 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:32:43.448657 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:32:43.448657 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:32:43.448657 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:32:43.448657 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:32:43.448657 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:32:43.448657 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:32:43.448657 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 94569190-57da-4623-91c3-3b6e4cff117b could not be found. Aug 10 11:32:43.448657 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:32:43.450494 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-737e082f-eac4-427a-bb80-5800fdfc46a1 tempest-VolumesNegativeTest-25303028 tempest-VolumesNegativeTest-25303028-project] Returning 404 to user: Volume 94569190-57da-4623-91c3-3b6e4cff117b could not be found. {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:32:43.451979 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-737e082f-eac4-427a-bb80-5800fdfc46a1 tempest-VolumesNegativeTest-25303028 tempest-VolumesNegativeTest-25303028-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/94569190-57da-4623-91c3-3b6e4cff117b" status: 404 len: 109 microversion: 2.1 time: 0.049262 Aug 10 11:32:43.456228 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 13/26] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Aug 10 11:32:43 2022] GET /compute/v2.1/os-volumes/94569190-57da-4623-91c3-3b6e4cff117b => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 11:32:44.568481 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-88018175-4951-4347-bc78-24860c781752 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Action: 'create', calling method: .version_select at 0x7fb7cfb1aee0>, body: {"keypair": {"name": "tempest-keypair-149698831", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO80PMAFO6+nAb1McshG6QUv3ZZwNf3M6hJ5LspYhruobWGdH4u1cFq7rFRYUx2AiOm8UUaF4ExaKNRhv8zxNpcm6wt04aN1XhOxVBLsX2Nhtow/BNoQJ+gw5DXDMmBzpA=="}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:32:44.701869 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-88018175-4951-4347-bc78-24860c781752 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Getting quotas for project bc3366c89fa049939147e3761e0c8d1a. Resources: {'key_pairs'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:32:44.713819 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-88018175-4951-4347-bc78-24860c781752 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Getting quotas for user 84c1f36162fa4537923cd19f21bbd20c and project bc3366c89fa049939147e3761e0c8d1a. Resources: {'key_pairs'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:32:44.871630 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-88018175-4951-4347-bc78-24860c781752 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.713942 Aug 10 11:32:44.881623 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 14/27] 10.222.0.62 () {62 vars in 1200 bytes} [Wed Aug 10 11:32:44 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 725 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 10 11:32:47.819495 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-66c97411-20ba-453e-a0f3-7c54d2b15b73 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2084021014", "imageRef": "99bbc441-5102-4a51-a496-cfbffeb3033a", "flavorRef": "452", "networks": [{"uuid": "d102d081-8c69-47b6-afdc-5c97e89f5998"}]}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:32:48.148492 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.network.neutron [None req-66c97411-20ba-453e-a0f3-7c54d2b15b73 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] validate_networks() for [('d102d081-8c69-47b6-afdc-5c97e89f5998', None, None, None, None, None)] {{(pid=124682) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:32:48.633004 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-73ce1fba-37d6-42cb-8cb8-630ce9c9336c tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Action: 'create', calling method: .version_select at 0x7fb7cfab2160>, body: {"keypair": {"name": "tempest-keypair-353850793", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfioHsE8TT5+mEKif825ob7kc4/tHy1Iq/BGPnGMRXbOmoSyeQZ1w3zWrUh0imDTdcOuMpjL3rhB8QNJv1Qk1LboK+w6YKnJ0hW3gXzXYOu8jZXA2OkVhTzR7iMx2nvvg=="}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:32:48.662684 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-73ce1fba-37d6-42cb-8cb8-630ce9c9336c tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Getting quotas for project 1aad65fe5d6c49bfad958684f6a79c22. Resources: {'key_pairs'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:32:48.667282 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-73ce1fba-37d6-42cb-8cb8-630ce9c9336c tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Getting quotas for user 2a528c05e8294590a0b9c1227593276f and project 1aad65fe5d6c49bfad958684f6a79c22. Resources: {'key_pairs'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:32:48.802107 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-73ce1fba-37d6-42cb-8cb8-630ce9c9336c tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.781665 Aug 10 11:32:48.802857 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 15/28] 10.222.0.62 () {60 vars in 1159 bytes} [Wed Aug 10 11:32:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:32:50.590080 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-66c97411-20ba-453e-a0f3-7c54d2b15b73 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Flavor limits 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:32:50.590080 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-66c97411-20ba-453e-a0f3-7c54d2b15b73 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Image limits 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:32:50.590080 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-66c97411-20ba-453e-a0f3-7c54d2b15b73 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Flavor pref 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:32:50.590080 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-66c97411-20ba-453e-a0f3-7c54d2b15b73 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Image pref 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:32:50.590080 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-66c97411-20ba-453e-a0f3-7c54d2b15b73 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:32:50.604250 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-66c97411-20ba-453e-a0f3-7c54d2b15b73 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:50.605022 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-66c97411-20ba-453e-a0f3-7c54d2b15b73 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:50.605869 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-66c97411-20ba-453e-a0f3-7c54d2b15b73 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:50.606780 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-66c97411-20ba-453e-a0f3-7c54d2b15b73 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:50.607423 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-66c97411-20ba-453e-a0f3-7c54d2b15b73 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:50.608107 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-66c97411-20ba-453e-a0f3-7c54d2b15b73 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:50.643848 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-66c97411-20ba-453e-a0f3-7c54d2b15b73 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Getting quotas for project 34d79610ecd1460182af0946d8beba5f. Resources: {'ram', 'instances', 'cores'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:32:50.652213 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-66c97411-20ba-453e-a0f3-7c54d2b15b73 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Getting quotas for user c12ec9d7cfec45ebbf390765794cbad5 and project 34d79610ecd1460182af0946d8beba5f. Resources: {'ram', 'instances', 'cores'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:32:50.666200 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-66c97411-20ba-453e-a0f3-7c54d2b15b73 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Going to run 1 instances... {{(pid=124682) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:32:50.669538 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-66c97411-20ba-453e-a0f3-7c54d2b15b73 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] [instance: 420b7baa-d100-4d8d-973f-3b29beebba6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99bbc441-5102-4a51-a496-cfbffeb3033a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:32:50.823188 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-66c97411-20ba-453e-a0f3-7c54d2b15b73 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.371208 Aug 10 11:32:50.824379 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 14/29] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Aug 10 11:32:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 3373 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 11:32:50.836732 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f976e0a7-bff9-4365-86fd-ee5f4bca3d1e tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:50.837155 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-f976e0a7-bff9-4365-86fd-ee5f4bca3d1e tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] [instance: 420b7baa-d100-4d8d-973f-3b29beebba6b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:51.008576 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-f976e0a7-bff9-4365-86fd-ee5f4bca3d1e tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12ec9d7cfec45ebbf390765794cbad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d79610ecd1460182af0946d8beba5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:51.032398 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-f976e0a7-bff9-4365-86fd-ee5f4bca3d1e tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] 10.222.0.62 "GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b" status: 200 len: 1215 microversion: 2.1 time: 0.199755 Aug 10 11:32:51.045743 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 16/30] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:32:50 2022] GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b => generated 1215 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:32:51.475949 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-f032359a-462e-4961-83c6-5682f6fd7f92 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-272977719", "imageRef": "99bbc441-5102-4a51-a496-cfbffeb3033a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:32:51.655856 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.network.neutron [None req-f032359a-462e-4961-83c6-5682f6fd7f92 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] validate_networks() for [('33de9024-0342-43c4-b011-697e74d98369', None, None, None, None, None)] {{(pid=124682) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:32:51.697016 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-c647f03b-7eb0-40a4-94bc-c8d5fcb9a57c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-600598298", "imageRef": "99bbc441-5102-4a51-a496-cfbffeb3033a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a343c28e-970e-43e5-9083-e849cc490dbe"}], "security_groups": [{"name": "tempest-securitygroup--1696443806"}], "key_name": "tempest-keypair-149698831", "user_data": "}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:32:52.323913 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.network.neutron [None req-c647f03b-7eb0-40a4-94bc-c8d5fcb9a57c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] validate_networks() for [('a343c28e-970e-43e5-9083-e849cc490dbe', None, None, None, None, None)] {{(pid=124683) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:32:52.526949 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-f032359a-462e-4961-83c6-5682f6fd7f92 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Flavor limits 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:32:52.527384 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-f032359a-462e-4961-83c6-5682f6fd7f92 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Image limits 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:32:52.527855 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-f032359a-462e-4961-83c6-5682f6fd7f92 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Flavor pref 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:32:52.528474 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-f032359a-462e-4961-83c6-5682f6fd7f92 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Image pref 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:32:52.529051 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-f032359a-462e-4961-83c6-5682f6fd7f92 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:32:52.567479 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f032359a-462e-4961-83c6-5682f6fd7f92 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:52.568203 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f032359a-462e-4961-83c6-5682f6fd7f92 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:52.568479 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f032359a-462e-4961-83c6-5682f6fd7f92 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:52.574211 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f032359a-462e-4961-83c6-5682f6fd7f92 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:52.576503 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f032359a-462e-4961-83c6-5682f6fd7f92 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:52.582758 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f032359a-462e-4961-83c6-5682f6fd7f92 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:52.636077 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-f032359a-462e-4961-83c6-5682f6fd7f92 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Getting quotas for project a66fd06041084a16b8d5c5b9a9dbea52. Resources: {'ram', 'instances', 'cores'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:32:52.648190 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-f032359a-462e-4961-83c6-5682f6fd7f92 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Getting quotas for user 81be34fdd1d741719b317b4fed21636d and project a66fd06041084a16b8d5c5b9a9dbea52. Resources: {'ram', 'instances', 'cores'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:32:52.689596 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-f032359a-462e-4961-83c6-5682f6fd7f92 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Going to run 1 instances... {{(pid=124682) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:32:52.695802 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-f032359a-462e-4961-83c6-5682f6fd7f92 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 85d76c52-fcda-4805-aa95-a00f88e39970] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99bbc441-5102-4a51-a496-cfbffeb3033a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:32:52.887880 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-f032359a-462e-4961-83c6-5682f6fd7f92 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.031736 Aug 10 11:32:52.891464 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 15/31] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Aug 10 11:32:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 2036 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 11:32:52.920555 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-188a8d35-30e5-47d2-be3a-2df70f8642c7 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:52.929123 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-188a8d35-30e5-47d2-be3a-2df70f8642c7 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] [instance: 420b7baa-d100-4d8d-973f-3b29beebba6b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:53.225745 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-188a8d35-30e5-47d2-be3a-2df70f8642c7 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12ec9d7cfec45ebbf390765794cbad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d79610ecd1460182af0946d8beba5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:53.284933 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-188a8d35-30e5-47d2-be3a-2df70f8642c7 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] 10.222.0.62 "GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b" status: 200 len: 1215 microversion: 2.1 time: 0.389392 Aug 10 11:32:53.285611 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 16/32] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:32:52 2022] GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b => generated 1215 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:32:53.295532 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-3b0bfcb7-e17f-4966-9ced-34152a47efd8 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:53.302358 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-3b0bfcb7-e17f-4966-9ced-34152a47efd8 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 85d76c52-fcda-4805-aa95-a00f88e39970] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:53.427028 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-3b0bfcb7-e17f-4966-9ced-34152a47efd8 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:53.437818 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-3b0bfcb7-e17f-4966-9ced-34152a47efd8 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970" status: 200 len: 1221 microversion: 2.1 time: 0.148000 Aug 10 11:32:53.442229 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 17/33] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:32:53 2022] GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970 => generated 1221 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:32:53.942980 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-32ee513a-3225-495e-b74c-3b544e310667 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-705545385", "imageRef": "99bbc441-5102-4a51-a496-cfbffeb3033a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:32:54.056360 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.network.neutron [None req-32ee513a-3225-495e-b74c-3b544e310667 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] validate_networks() for [('33de9024-0342-43c4-b011-697e74d98369', None, None, None, None, None)] {{(pid=124682) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:32:54.898067 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-32ee513a-3225-495e-b74c-3b544e310667 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Flavor limits 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:32:54.898787 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-32ee513a-3225-495e-b74c-3b544e310667 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Image limits 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:32:54.899643 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-32ee513a-3225-495e-b74c-3b544e310667 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Flavor pref 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:32:54.900779 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-32ee513a-3225-495e-b74c-3b544e310667 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Image pref 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:32:54.901366 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-32ee513a-3225-495e-b74c-3b544e310667 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:32:54.914634 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-32ee513a-3225-495e-b74c-3b544e310667 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:54.915409 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-32ee513a-3225-495e-b74c-3b544e310667 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:54.916213 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-32ee513a-3225-495e-b74c-3b544e310667 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:54.917273 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-32ee513a-3225-495e-b74c-3b544e310667 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:54.917906 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-32ee513a-3225-495e-b74c-3b544e310667 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:54.919224 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-32ee513a-3225-495e-b74c-3b544e310667 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:54.980179 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-32ee513a-3225-495e-b74c-3b544e310667 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Getting quotas for project a66fd06041084a16b8d5c5b9a9dbea52. Resources: {'ram', 'instances', 'cores'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:32:54.980179 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-32ee513a-3225-495e-b74c-3b544e310667 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Getting quotas for user 81be34fdd1d741719b317b4fed21636d and project a66fd06041084a16b8d5c5b9a9dbea52. Resources: {'ram', 'instances', 'cores'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:32:54.987554 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-32ee513a-3225-495e-b74c-3b544e310667 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Going to run 1 instances... {{(pid=124682) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:32:54.995288 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-32ee513a-3225-495e-b74c-3b544e310667 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99bbc441-5102-4a51-a496-cfbffeb3033a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:32:55.229513 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-32ee513a-3225-495e-b74c-3b544e310667 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.289212 Aug 10 11:32:55.243597 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 18/34] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Aug 10 11:32:53 2022] POST /compute/v2.1/servers => generated 383 bytes in 1306 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 11:32:55.254303 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-a8f199b2-14ff-471a-8fc0-31e4fade29ff tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:55.256836 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-a8f199b2-14ff-471a-8fc0-31e4fade29ff tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] [instance: 420b7baa-d100-4d8d-973f-3b29beebba6b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:55.281530 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a8f199b2-14ff-471a-8fc0-31e4fade29ff tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:55.281530 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a8f199b2-14ff-471a-8fc0-31e4fade29ff tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:55.281530 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a8f199b2-14ff-471a-8fc0-31e4fade29ff tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:55.281530 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a8f199b2-14ff-471a-8fc0-31e4fade29ff tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:55.282038 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a8f199b2-14ff-471a-8fc0-31e4fade29ff tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:55.291601 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-c647f03b-7eb0-40a4-94bc-c8d5fcb9a57c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Flavor limits 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:32:55.292096 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-c647f03b-7eb0-40a4-94bc-c8d5fcb9a57c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Image limits 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:32:55.292789 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-c647f03b-7eb0-40a4-94bc-c8d5fcb9a57c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Flavor pref 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:32:55.293193 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-c647f03b-7eb0-40a4-94bc-c8d5fcb9a57c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Image pref 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:32:55.293614 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-c647f03b-7eb0-40a4-94bc-c8d5fcb9a57c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:32:55.308600 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a8f199b2-14ff-471a-8fc0-31e4fade29ff tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:55.331405 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c647f03b-7eb0-40a4-94bc-c8d5fcb9a57c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:55.332087 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c647f03b-7eb0-40a4-94bc-c8d5fcb9a57c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:55.334042 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c647f03b-7eb0-40a4-94bc-c8d5fcb9a57c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:55.335092 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c647f03b-7eb0-40a4-94bc-c8d5fcb9a57c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:55.337716 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c647f03b-7eb0-40a4-94bc-c8d5fcb9a57c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:55.338857 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c647f03b-7eb0-40a4-94bc-c8d5fcb9a57c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:55.428611 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-c647f03b-7eb0-40a4-94bc-c8d5fcb9a57c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Getting quotas for project bc3366c89fa049939147e3761e0c8d1a. Resources: {'ram', 'instances', 'cores'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:32:55.445340 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-c647f03b-7eb0-40a4-94bc-c8d5fcb9a57c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Getting quotas for user 84c1f36162fa4537923cd19f21bbd20c and project bc3366c89fa049939147e3761e0c8d1a. Resources: {'ram', 'instances', 'cores'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:32:55.483769 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-c647f03b-7eb0-40a4-94bc-c8d5fcb9a57c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Going to run 1 instances... {{(pid=124683) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:32:55.494036 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-c647f03b-7eb0-40a4-94bc-c8d5fcb9a57c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99bbc441-5102-4a51-a496-cfbffeb3033a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124683) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:32:55.543665 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-a8f199b2-14ff-471a-8fc0-31e4fade29ff tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12ec9d7cfec45ebbf390765794cbad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d79610ecd1460182af0946d8beba5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:55.562253 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-a8f199b2-14ff-471a-8fc0-31e4fade29ff tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] 10.222.0.62 "GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b" status: 200 len: 1267 microversion: 2.1 time: 0.317124 Aug 10 11:32:55.578535 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 19/35] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:32:55 2022] GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b => generated 1267 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:32:55.604020 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-713d3de5-e35f-49e6-bc5c-d29625fa1788 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:55.604996 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-713d3de5-e35f-49e6-bc5c-d29625fa1788 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:55.683324 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-713d3de5-e35f-49e6-bc5c-d29625fa1788 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:55.691335 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-713d3de5-e35f-49e6-bc5c-d29625fa1788 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1221 microversion: 2.1 time: 0.110926 Aug 10 11:32:55.691914 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 20/36] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:32:55 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1221 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:32:55.700021 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-5049ffe2-49c1-418e-b566-96811ec56cf1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1145474368", "imageRef": "99bbc441-5102-4a51-a496-cfbffeb3033a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5775eed8-b840-4741-8a0a-1ab22fd30792"}], "security_groups": [{"name": "tempest-securitygroup--84985604"}], "key_name": "tempest-keypair-353850793", "user_data": "}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:32:55.786511 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-c647f03b-7eb0-40a4-94bc-c8d5fcb9a57c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.100349 Aug 10 11:32:55.810765 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 17/37] 10.222.0.62 () {62 vars in 1188 bytes} [Wed Aug 10 11:32:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 4125 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 10 11:32:55.850232 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-d2473784-87a8-4e0d-ae57-eb66855b390d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:55.851257 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-d2473784-87a8-4e0d-ae57-eb66855b390d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:55.993574 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-d2473784-87a8-4e0d-ae57-eb66855b390d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:56.002018 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-d2473784-87a8-4e0d-ae57-eb66855b390d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:56.003549 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-d2473784-87a8-4e0d-ae57-eb66855b390d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:56.008498 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-d2473784-87a8-4e0d-ae57-eb66855b390d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1280 microversion: 2.20 time: 0.190541 Aug 10 11:32:56.010638 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 18/38] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:32:55 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1280 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:32:56.455874 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.network.neutron [None req-5049ffe2-49c1-418e-b566-96811ec56cf1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] validate_networks() for [('5775eed8-b840-4741-8a0a-1ab22fd30792', None, None, None, None, None)] {{(pid=124682) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:32:56.585500 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-aaee280c-0dc5-4477-be3e-efb7ac983b7b tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:56.586134 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-aaee280c-0dc5-4477-be3e-efb7ac983b7b tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] [instance: 420b7baa-d100-4d8d-973f-3b29beebba6b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:56.615247 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-aaee280c-0dc5-4477-be3e-efb7ac983b7b tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:56.615761 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-aaee280c-0dc5-4477-be3e-efb7ac983b7b tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:56.616289 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-aaee280c-0dc5-4477-be3e-efb7ac983b7b tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:56.617081 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-aaee280c-0dc5-4477-be3e-efb7ac983b7b tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:56.623190 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-aaee280c-0dc5-4477-be3e-efb7ac983b7b tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:56.625489 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-aaee280c-0dc5-4477-be3e-efb7ac983b7b tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:57.051391 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-aaee280c-0dc5-4477-be3e-efb7ac983b7b tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12ec9d7cfec45ebbf390765794cbad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d79610ecd1460182af0946d8beba5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:57.083004 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-aaee280c-0dc5-4477-be3e-efb7ac983b7b tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] 10.222.0.62 "GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b" status: 200 len: 1273 microversion: 2.1 time: 0.499914 Aug 10 11:32:57.084699 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 19/39] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:32:56 2022] GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b => generated 1273 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:32:57.095851 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-404d3549-5a94-4f93-b47c-0db443f556be tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:57.096726 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-404d3549-5a94-4f93-b47c-0db443f556be tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:57.109554 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-404d3549-5a94-4f93-b47c-0db443f556be tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:57.110349 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-404d3549-5a94-4f93-b47c-0db443f556be tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:57.111043 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-404d3549-5a94-4f93-b47c-0db443f556be tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:57.112229 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-404d3549-5a94-4f93-b47c-0db443f556be tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:57.112918 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-404d3549-5a94-4f93-b47c-0db443f556be tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:57.113547 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-404d3549-5a94-4f93-b47c-0db443f556be tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:57.267912 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-404d3549-5a94-4f93-b47c-0db443f556be tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:57.282865 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-404d3549-5a94-4f93-b47c-0db443f556be tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1225 microversion: 2.1 time: 0.196244 Aug 10 11:32:57.288947 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 20/40] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:32:57 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1225 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:32:57.295009 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-c6ce4fee-2c5b-4772-8a47-a964294da02d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:57.295626 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-c6ce4fee-2c5b-4772-8a47-a964294da02d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:57.403252 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-c6ce4fee-2c5b-4772-8a47-a964294da02d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:57.416633 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-c6ce4fee-2c5b-4772-8a47-a964294da02d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:57.430392 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-c6ce4fee-2c5b-4772-8a47-a964294da02d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:57.431554 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-c6ce4fee-2c5b-4772-8a47-a964294da02d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1280 microversion: 2.20 time: 0.141586 Aug 10 11:32:57.448980 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 21/41] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:32:57 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1280 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:32:57.975350 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-5049ffe2-49c1-418e-b566-96811ec56cf1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Flavor limits 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:32:57.975951 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-5049ffe2-49c1-418e-b566-96811ec56cf1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Image limits 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:32:57.976497 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-5049ffe2-49c1-418e-b566-96811ec56cf1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Flavor pref 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:32:57.976923 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-5049ffe2-49c1-418e-b566-96811ec56cf1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Image pref 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:32:57.977343 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-5049ffe2-49c1-418e-b566-96811ec56cf1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:32:57.996417 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5049ffe2-49c1-418e-b566-96811ec56cf1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:57.996791 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5049ffe2-49c1-418e-b566-96811ec56cf1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:57.998257 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5049ffe2-49c1-418e-b566-96811ec56cf1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:58.000398 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5049ffe2-49c1-418e-b566-96811ec56cf1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:58.009378 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5049ffe2-49c1-418e-b566-96811ec56cf1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:58.009378 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5049ffe2-49c1-418e-b566-96811ec56cf1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:58.088711 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-5049ffe2-49c1-418e-b566-96811ec56cf1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Getting quotas for project 1aad65fe5d6c49bfad958684f6a79c22. Resources: {'ram', 'instances', 'cores'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:32:58.105498 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-5049ffe2-49c1-418e-b566-96811ec56cf1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Getting quotas for user 2a528c05e8294590a0b9c1227593276f and project 1aad65fe5d6c49bfad958684f6a79c22. Resources: {'ram', 'instances', 'cores'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:32:58.106397 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-db04d8c4-046d-4967-9db0-b2c732ee9fca tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:58.107672 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-db04d8c4-046d-4967-9db0-b2c732ee9fca tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] [instance: 420b7baa-d100-4d8d-973f-3b29beebba6b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:58.118345 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-db04d8c4-046d-4967-9db0-b2c732ee9fca tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:58.121163 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-db04d8c4-046d-4967-9db0-b2c732ee9fca tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:58.122877 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-db04d8c4-046d-4967-9db0-b2c732ee9fca tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:58.125363 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-db04d8c4-046d-4967-9db0-b2c732ee9fca tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:58.126074 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-db04d8c4-046d-4967-9db0-b2c732ee9fca tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:58.138148 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-db04d8c4-046d-4967-9db0-b2c732ee9fca tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:58.178456 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-5049ffe2-49c1-418e-b566-96811ec56cf1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Going to run 1 instances... {{(pid=124682) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:32:58.191044 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-5049ffe2-49c1-418e-b566-96811ec56cf1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99bbc441-5102-4a51-a496-cfbffeb3033a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:32:58.305074 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-db04d8c4-046d-4967-9db0-b2c732ee9fca tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12ec9d7cfec45ebbf390765794cbad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d79610ecd1460182af0946d8beba5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:58.316608 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-db04d8c4-046d-4967-9db0-b2c732ee9fca tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] 10.222.0.62 "GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b" status: 200 len: 1273 microversion: 2.1 time: 0.214541 Aug 10 11:32:58.350415 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 22/42] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:32:58 2022] GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b => generated 1273 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:32:58.355669 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-8e911d80-4ea4-46d9-8cb2-55c4927978eb tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:58.372993 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-8e911d80-4ea4-46d9-8cb2-55c4927978eb tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:58.382808 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8e911d80-4ea4-46d9-8cb2-55c4927978eb tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:58.386398 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8e911d80-4ea4-46d9-8cb2-55c4927978eb tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:58.387046 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8e911d80-4ea4-46d9-8cb2-55c4927978eb tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:58.390709 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8e911d80-4ea4-46d9-8cb2-55c4927978eb tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:58.390871 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-5049ffe2-49c1-418e-b566-96811ec56cf1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 2.696708 Aug 10 11:32:58.391911 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 21/43] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Aug 10 11:32:55 2022] POST /compute/v2.1/servers => generated 400 bytes in 2698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 11:32:58.392605 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8e911d80-4ea4-46d9-8cb2-55c4927978eb tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:58.395508 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8e911d80-4ea4-46d9-8cb2-55c4927978eb tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:58.425648 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-0ca6dfc2-7fee-4b36-8fc8-5e1a769464b6 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:58.431716 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-0ca6dfc2-7fee-4b36-8fc8-5e1a769464b6 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:58.865087 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-8e911d80-4ea4-46d9-8cb2-55c4927978eb tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:58.871358 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-0ca6dfc2-7fee-4b36-8fc8-5e1a769464b6 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:58.879084 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-8e911d80-4ea4-46d9-8cb2-55c4927978eb tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1281 microversion: 2.1 time: 0.527110 Aug 10 11:32:58.879767 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-0ca6dfc2-7fee-4b36-8fc8-5e1a769464b6 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1237 microversion: 2.1 time: 0.471150 Aug 10 11:32:58.880180 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 23/44] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:32:58 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1281 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:32:58.894288 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 22/45] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:32:58 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1237 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:32:58.897520 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-6fb7c138-51b4-4e79-961a-742b90e9ca78 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:58.899460 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-6fb7c138-51b4-4e79-961a-742b90e9ca78 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:58.919573 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6fb7c138-51b4-4e79-961a-742b90e9ca78 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:58.920177 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6fb7c138-51b4-4e79-961a-742b90e9ca78 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:58.921746 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6fb7c138-51b4-4e79-961a-742b90e9ca78 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:58.922647 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6fb7c138-51b4-4e79-961a-742b90e9ca78 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:58.923339 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6fb7c138-51b4-4e79-961a-742b90e9ca78 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:58.924149 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6fb7c138-51b4-4e79-961a-742b90e9ca78 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:59.053129 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-6fb7c138-51b4-4e79-961a-742b90e9ca78 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:59.084243 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-6fb7c138-51b4-4e79-961a-742b90e9ca78 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:59.084243 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-6fb7c138-51b4-4e79-961a-742b90e9ca78 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:59.084243 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-6fb7c138-51b4-4e79-961a-742b90e9ca78 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1332 microversion: 2.20 time: 0.190832 Aug 10 11:32:59.084855 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 24/46] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:32:58 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1332 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:32:59.348226 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-388920fb-e69c-40d3-af41-c5856e632d09 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:59.348226 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-388920fb-e69c-40d3-af41-c5856e632d09 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] [instance: 420b7baa-d100-4d8d-973f-3b29beebba6b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:59.354035 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-388920fb-e69c-40d3-af41-c5856e632d09 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:59.354542 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-388920fb-e69c-40d3-af41-c5856e632d09 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:59.357106 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-388920fb-e69c-40d3-af41-c5856e632d09 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:59.358030 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-388920fb-e69c-40d3-af41-c5856e632d09 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:59.359652 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-388920fb-e69c-40d3-af41-c5856e632d09 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:59.362010 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-388920fb-e69c-40d3-af41-c5856e632d09 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:59.915737 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-fe23cd78-b18a-42ea-8c33-b9395e41fc33 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:59.915737 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-fe23cd78-b18a-42ea-8c33-b9395e41fc33 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:00.142829 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-388920fb-e69c-40d3-af41-c5856e632d09 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12ec9d7cfec45ebbf390765794cbad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d79610ecd1460182af0946d8beba5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:00.163085 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-388920fb-e69c-40d3-af41-c5856e632d09 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] 10.222.0.62 "GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b" status: 200 len: 1315 microversion: 2.1 time: 0.825594 Aug 10 11:33:00.163593 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 23/47] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:32:59 2022] GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b => generated 1315 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:33:00.206698 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-0576720d-37fc-401f-93cf-91633c7ee02d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:00.209180 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-0576720d-37fc-401f-93cf-91633c7ee02d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:00.237207 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-fe23cd78-b18a-42ea-8c33-b9395e41fc33 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:00.242469 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0576720d-37fc-401f-93cf-91633c7ee02d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:00.243700 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0576720d-37fc-401f-93cf-91633c7ee02d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:00.244354 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0576720d-37fc-401f-93cf-91633c7ee02d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:00.245355 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0576720d-37fc-401f-93cf-91633c7ee02d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:00.246074 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-fe23cd78-b18a-42ea-8c33-b9395e41fc33 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1237 microversion: 2.1 time: 0.347099 Aug 10 11:33:00.246297 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0576720d-37fc-401f-93cf-91633c7ee02d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:00.247071 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0576720d-37fc-401f-93cf-91633c7ee02d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:00.253605 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 25/48] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:32:59 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1237 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:33:00.263699 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-abe58e32-6846-4b4d-95d7-c0f17b80f577 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:00.273996 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-abe58e32-6846-4b4d-95d7-c0f17b80f577 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:00.300156 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-abe58e32-6846-4b4d-95d7-c0f17b80f577 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:00.300156 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-abe58e32-6846-4b4d-95d7-c0f17b80f577 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:00.300156 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-abe58e32-6846-4b4d-95d7-c0f17b80f577 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:00.304113 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-abe58e32-6846-4b4d-95d7-c0f17b80f577 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:00.306692 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-abe58e32-6846-4b4d-95d7-c0f17b80f577 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:00.307315 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-abe58e32-6846-4b4d-95d7-c0f17b80f577 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:00.498963 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-0576720d-37fc-401f-93cf-91633c7ee02d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:00.515323 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-0576720d-37fc-401f-93cf-91633c7ee02d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1279 microversion: 2.1 time: 0.340730 Aug 10 11:33:00.519193 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 24/49] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:00 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1279 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:00.573646 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-abe58e32-6846-4b4d-95d7-c0f17b80f577 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:00.585995 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-abe58e32-6846-4b4d-95d7-c0f17b80f577 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:00.590610 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-abe58e32-6846-4b4d-95d7-c0f17b80f577 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:00.593475 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-abe58e32-6846-4b4d-95d7-c0f17b80f577 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1340 microversion: 2.20 time: 0.336969 Aug 10 11:33:00.594921 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 26/50] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:33:00 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1340 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:33:01.191578 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-77857509-cb51-4369-84d6-eb556777a845 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:01.191578 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-77857509-cb51-4369-84d6-eb556777a845 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] [instance: 420b7baa-d100-4d8d-973f-3b29beebba6b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:01.208269 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-77857509-cb51-4369-84d6-eb556777a845 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:01.209331 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-77857509-cb51-4369-84d6-eb556777a845 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:01.210397 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-77857509-cb51-4369-84d6-eb556777a845 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:01.219835 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-77857509-cb51-4369-84d6-eb556777a845 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:01.223752 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-77857509-cb51-4369-84d6-eb556777a845 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:01.224954 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-77857509-cb51-4369-84d6-eb556777a845 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:01.277439 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-81ac150f-9695-4878-96a6-0c85ed6dbcbc tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:01.278253 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-81ac150f-9695-4878-96a6-0c85ed6dbcbc tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:01.304163 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-81ac150f-9695-4878-96a6-0c85ed6dbcbc tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:01.305922 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-81ac150f-9695-4878-96a6-0c85ed6dbcbc tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:01.310391 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-81ac150f-9695-4878-96a6-0c85ed6dbcbc tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:01.326463 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-81ac150f-9695-4878-96a6-0c85ed6dbcbc tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:01.327674 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-81ac150f-9695-4878-96a6-0c85ed6dbcbc tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:01.336091 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-81ac150f-9695-4878-96a6-0c85ed6dbcbc tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:01.693172 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-81ac150f-9695-4878-96a6-0c85ed6dbcbc tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:01.709160 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-81ac150f-9695-4878-96a6-0c85ed6dbcbc tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1241 microversion: 2.1 time: 0.434499 Aug 10 11:33:01.709719 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 27/51] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:01 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1241 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:33:01.741334 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-ed068cc4-1ad4-4342-a376-2a6144796260 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:01.742082 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-ed068cc4-1ad4-4342-a376-2a6144796260 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:01.758033 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ed068cc4-1ad4-4342-a376-2a6144796260 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:01.758534 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ed068cc4-1ad4-4342-a376-2a6144796260 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:01.758980 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ed068cc4-1ad4-4342-a376-2a6144796260 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:01.759697 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ed068cc4-1ad4-4342-a376-2a6144796260 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:01.760225 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ed068cc4-1ad4-4342-a376-2a6144796260 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:01.764431 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ed068cc4-1ad4-4342-a376-2a6144796260 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:02.325190 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-77857509-cb51-4369-84d6-eb556777a845 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12ec9d7cfec45ebbf390765794cbad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d79610ecd1460182af0946d8beba5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:02.346863 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-77857509-cb51-4369-84d6-eb556777a845 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] 10.222.0.62 "GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b" status: 200 len: 1315 microversion: 2.1 time: 1.156636 Aug 10 11:33:02.349752 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 25/52] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:01 2022] GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b => generated 1315 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:02.360972 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-f56ab53a-8483-49d4-94aa-550f1c024799 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:02.364228 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-f56ab53a-8483-49d4-94aa-550f1c024799 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:02.396754 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f56ab53a-8483-49d4-94aa-550f1c024799 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:02.397852 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f56ab53a-8483-49d4-94aa-550f1c024799 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:02.398588 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f56ab53a-8483-49d4-94aa-550f1c024799 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:02.399561 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f56ab53a-8483-49d4-94aa-550f1c024799 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:02.400380 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f56ab53a-8483-49d4-94aa-550f1c024799 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:02.401249 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f56ab53a-8483-49d4-94aa-550f1c024799 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:02.729124 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-f56ab53a-8483-49d4-94aa-550f1c024799 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:02.729124 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-f56ab53a-8483-49d4-94aa-550f1c024799 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:02.729458 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-f56ab53a-8483-49d4-94aa-550f1c024799 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:02.730936 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-f56ab53a-8483-49d4-94aa-550f1c024799 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1338 microversion: 2.20 time: 0.373989 Aug 10 11:33:02.733853 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 26/53] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:33:02 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1338 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:33:02.744739 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-c4ee2fdf-c2a3-4001-98fc-40c60bdb7f93 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:02.745915 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-c4ee2fdf-c2a3-4001-98fc-40c60bdb7f93 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:02.763203 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c4ee2fdf-c2a3-4001-98fc-40c60bdb7f93 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:02.763873 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c4ee2fdf-c2a3-4001-98fc-40c60bdb7f93 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:02.768483 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c4ee2fdf-c2a3-4001-98fc-40c60bdb7f93 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:02.769437 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c4ee2fdf-c2a3-4001-98fc-40c60bdb7f93 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:02.770085 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c4ee2fdf-c2a3-4001-98fc-40c60bdb7f93 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:02.770673 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c4ee2fdf-c2a3-4001-98fc-40c60bdb7f93 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:02.915020 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c4ee2fdf-c2a3-4001-98fc-40c60bdb7f93 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:02.925236 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-c4ee2fdf-c2a3-4001-98fc-40c60bdb7f93 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1297 microversion: 2.1 time: 0.188896 Aug 10 11:33:02.925821 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 27/54] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:02 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1297 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:03.125917 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-ed068cc4-1ad4-4342-a376-2a6144796260 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:03.143578 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-ed068cc4-1ad4-4342-a376-2a6144796260 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1321 microversion: 2.1 time: 1.426473 Aug 10 11:33:03.159590 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 28/55] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:01 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1321 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:03.370260 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-f43065f0-9ac2-45c8-9fb0-2c8103f7ce7a tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:03.370956 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-f43065f0-9ac2-45c8-9fb0-2c8103f7ce7a tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] [instance: 420b7baa-d100-4d8d-973f-3b29beebba6b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:03.383166 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f43065f0-9ac2-45c8-9fb0-2c8103f7ce7a tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:03.384612 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f43065f0-9ac2-45c8-9fb0-2c8103f7ce7a tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:03.385979 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f43065f0-9ac2-45c8-9fb0-2c8103f7ce7a tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:03.387951 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f43065f0-9ac2-45c8-9fb0-2c8103f7ce7a tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:03.402695 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f43065f0-9ac2-45c8-9fb0-2c8103f7ce7a tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:03.402695 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f43065f0-9ac2-45c8-9fb0-2c8103f7ce7a tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:03.763646 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-6be96ceb-5f50-4b28-bd9d-e58510f20476 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:03.765311 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-6be96ceb-5f50-4b28-bd9d-e58510f20476 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:03.785895 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6be96ceb-5f50-4b28-bd9d-e58510f20476 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:03.786614 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6be96ceb-5f50-4b28-bd9d-e58510f20476 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:03.788957 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6be96ceb-5f50-4b28-bd9d-e58510f20476 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:03.796526 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6be96ceb-5f50-4b28-bd9d-e58510f20476 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:03.798146 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6be96ceb-5f50-4b28-bd9d-e58510f20476 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:03.806104 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6be96ceb-5f50-4b28-bd9d-e58510f20476 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:04.291156 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-6be96ceb-5f50-4b28-bd9d-e58510f20476 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:04.305849 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-6be96ceb-5f50-4b28-bd9d-e58510f20476 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:04.311487 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-6be96ceb-5f50-4b28-bd9d-e58510f20476 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:04.317275 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-6be96ceb-5f50-4b28-bd9d-e58510f20476 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1406 microversion: 2.20 time: 0.558460 Aug 10 11:33:04.332754 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 29/56] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:33:03 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1406 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:33:04.337204 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-3f542096-84ec-417c-87a4-998fdf29de03 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:04.338148 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-3f542096-84ec-417c-87a4-998fdf29de03 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:04.348423 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3f542096-84ec-417c-87a4-998fdf29de03 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:04.351439 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3f542096-84ec-417c-87a4-998fdf29de03 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:04.352204 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3f542096-84ec-417c-87a4-998fdf29de03 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:04.354848 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3f542096-84ec-417c-87a4-998fdf29de03 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:04.355526 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3f542096-84ec-417c-87a4-998fdf29de03 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:04.357424 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3f542096-84ec-417c-87a4-998fdf29de03 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:04.595603 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-3f542096-84ec-417c-87a4-998fdf29de03 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:04.612617 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-3f542096-84ec-417c-87a4-998fdf29de03 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1295 microversion: 2.1 time: 0.292700 Aug 10 11:33:04.615469 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 30/57] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:04 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1295 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:04.626178 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-e6ce1113-a1a0-483f-b04e-8188a2f6819d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:04.628714 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-e6ce1113-a1a0-483f-b04e-8188a2f6819d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:04.682351 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e6ce1113-a1a0-483f-b04e-8188a2f6819d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:04.682351 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e6ce1113-a1a0-483f-b04e-8188a2f6819d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:04.682351 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e6ce1113-a1a0-483f-b04e-8188a2f6819d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:04.684513 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e6ce1113-a1a0-483f-b04e-8188a2f6819d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:04.687583 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e6ce1113-a1a0-483f-b04e-8188a2f6819d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:04.689350 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e6ce1113-a1a0-483f-b04e-8188a2f6819d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:05.130418 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-f43065f0-9ac2-45c8-9fb0-2c8103f7ce7a tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12ec9d7cfec45ebbf390765794cbad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d79610ecd1460182af0946d8beba5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:05.130418 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-f43065f0-9ac2-45c8-9fb0-2c8103f7ce7a tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] 10.222.0.62 "GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b" status: 200 len: 1315 microversion: 2.1 time: 1.735514 Aug 10 11:33:05.130418 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 28/58] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:03 2022] GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b => generated 1315 bytes in 1737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:05.132092 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-e6ce1113-a1a0-483f-b04e-8188a2f6819d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:05.152298 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-e6ce1113-a1a0-483f-b04e-8188a2f6819d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1321 microversion: 2.1 time: 0.518630 Aug 10 11:33:05.159225 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 31/59] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:04 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1321 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:05.348234 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-52d4fb58-ed6f-477a-8003-6ffe395b6ca4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:05.350467 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-52d4fb58-ed6f-477a-8003-6ffe395b6ca4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:05.382332 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-52d4fb58-ed6f-477a-8003-6ffe395b6ca4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:05.382947 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-52d4fb58-ed6f-477a-8003-6ffe395b6ca4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:05.385308 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-52d4fb58-ed6f-477a-8003-6ffe395b6ca4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:05.388356 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-52d4fb58-ed6f-477a-8003-6ffe395b6ca4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:05.389399 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-52d4fb58-ed6f-477a-8003-6ffe395b6ca4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:05.392222 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-52d4fb58-ed6f-477a-8003-6ffe395b6ca4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:05.638029 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-997bf748-1217-4b93-b7ba-4ce30afa1939 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:05.641790 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-997bf748-1217-4b93-b7ba-4ce30afa1939 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:05.643687 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=2 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:33:05.660263 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-997bf748-1217-4b93-b7ba-4ce30afa1939 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:05.664729 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-997bf748-1217-4b93-b7ba-4ce30afa1939 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:05.671627 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-997bf748-1217-4b93-b7ba-4ce30afa1939 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:05.672772 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-997bf748-1217-4b93-b7ba-4ce30afa1939 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:05.673410 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-997bf748-1217-4b93-b7ba-4ce30afa1939 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:05.673997 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-997bf748-1217-4b93-b7ba-4ce30afa1939 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:06.362224 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-997bf748-1217-4b93-b7ba-4ce30afa1939 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:06.395203 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-997bf748-1217-4b93-b7ba-4ce30afa1939 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1295 microversion: 2.1 time: 0.755543 Aug 10 11:33:06.411521 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 32/60] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:05 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1295 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:06.433284 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-7eb741a6-0906-4857-b5b3-b8e35184b7e1 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:06.433939 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-7eb741a6-0906-4857-b5b3-b8e35184b7e1 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] [instance: 420b7baa-d100-4d8d-973f-3b29beebba6b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:06.468925 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7eb741a6-0906-4857-b5b3-b8e35184b7e1 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:06.469445 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7eb741a6-0906-4857-b5b3-b8e35184b7e1 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:06.469886 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7eb741a6-0906-4857-b5b3-b8e35184b7e1 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:06.470636 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7eb741a6-0906-4857-b5b3-b8e35184b7e1 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:06.482535 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7eb741a6-0906-4857-b5b3-b8e35184b7e1 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:06.488750 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7eb741a6-0906-4857-b5b3-b8e35184b7e1 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:07.050402 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-52d4fb58-ed6f-477a-8003-6ffe395b6ca4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:07.060201 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-52d4fb58-ed6f-477a-8003-6ffe395b6ca4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:07.067707 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-52d4fb58-ed6f-477a-8003-6ffe395b6ca4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:07.080215 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-52d4fb58-ed6f-477a-8003-6ffe395b6ca4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1406 microversion: 2.20 time: 1.728621 Aug 10 11:33:07.080215 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 29/61] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:33:05 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1406 bytes in 1733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:33:07.085370 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-4aa05fbe-a5bd-468a-a070-df03aa04b19e tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:07.086287 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-4aa05fbe-a5bd-468a-a070-df03aa04b19e tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:07.098960 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:33:07.104883 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4aa05fbe-a5bd-468a-a070-df03aa04b19e tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:07.105630 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4aa05fbe-a5bd-468a-a070-df03aa04b19e tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:07.106152 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4aa05fbe-a5bd-468a-a070-df03aa04b19e tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:07.106950 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4aa05fbe-a5bd-468a-a070-df03aa04b19e tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:07.116277 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4aa05fbe-a5bd-468a-a070-df03aa04b19e tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:07.117717 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4aa05fbe-a5bd-468a-a070-df03aa04b19e tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:07.547799 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-7eb741a6-0906-4857-b5b3-b8e35184b7e1 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12ec9d7cfec45ebbf390765794cbad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d79610ecd1460182af0946d8beba5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:07.561344 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-7eb741a6-0906-4857-b5b3-b8e35184b7e1 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] 10.222.0.62 "GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b" status: 200 len: 1315 microversion: 2.1 time: 1.148444 Aug 10 11:33:07.562254 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 33/62] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:06 2022] GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b => generated 1315 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:07.781855 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-4aa05fbe-a5bd-468a-a070-df03aa04b19e tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:07.792153 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-4aa05fbe-a5bd-468a-a070-df03aa04b19e tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1321 microversion: 2.1 time: 0.718323 Aug 10 11:33:07.798969 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 30/63] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:07 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1321 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:07.886767 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-4028aaae-193a-4c9b-ad78-ce27fc8e09e3 req-a6bd9cea-7711-4ddd-9ff4-15d16f50582c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "420b7baa-d100-4d8d-973f-3b29beebba6b", "tag": "b777f638-0433-408a-abe4-fd50173e4085"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:33:07.930045 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-4028aaae-193a-4c9b-ad78-ce27fc8e09e3 req-a6bd9cea-7711-4ddd-9ff4-15d16f50582c service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:07.930907 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-4028aaae-193a-4c9b-ad78-ce27fc8e09e3 req-a6bd9cea-7711-4ddd-9ff4-15d16f50582c service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:07.932440 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-4028aaae-193a-4c9b-ad78-ce27fc8e09e3 req-a6bd9cea-7711-4ddd-9ff4-15d16f50582c service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:08.027210 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-4028aaae-193a-4c9b-ad78-ce27fc8e09e3 req-a6bd9cea-7711-4ddd-9ff4-15d16f50582c service nova] Creating event network-changed:b777f638-0433-408a-abe4-fd50173e4085 for instance 420b7baa-d100-4d8d-973f-3b29beebba6b on hv-cinder-85272 Aug 10 11:33:08.027748 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-4028aaae-193a-4c9b-ad78-ce27fc8e09e3 req-a6bd9cea-7711-4ddd-9ff4-15d16f50582c service nova] Acquiring lock "compute-rpcapi-router" {{(pid=124683) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 10 11:33:08.028205 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-4028aaae-193a-4c9b-ad78-ce27fc8e09e3 req-a6bd9cea-7711-4ddd-9ff4-15d16f50582c service nova] Acquired lock "compute-rpcapi-router" {{(pid=124683) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 10 11:33:08.029476 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6e8a0d97-3478-4bf4-b4ba-cef58ab2d7e8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:08.039353 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=8 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:33:08.052291 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6e8a0d97-3478-4bf4-b4ba-cef58ab2d7e8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:08.054575 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6e8a0d97-3478-4bf4-b4ba-cef58ab2d7e8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:08.075202 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6e8a0d97-3478-4bf4-b4ba-cef58ab2d7e8 None None] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:08.080001 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6e8a0d97-3478-4bf4-b4ba-cef58ab2d7e8 None None] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:08.080746 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6e8a0d97-3478-4bf4-b4ba-cef58ab2d7e8 None None] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:08.145154 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.compute.rpcapi [None req-6e8a0d97-3478-4bf4-b4ba-cef58ab2d7e8 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 10 11:33:08.152009 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-ec649b22-e230-44cf-a4d2-dfede8ab3f15 req-41bbdbab-8689-470a-a04c-9143a6a2c497 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85d76c52-fcda-4805-aa95-a00f88e39970", "tag": "e488c9e1-d9f1-4e1f-8ee8-652d229c8978"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:33:08.158397 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6e8a0d97-3478-4bf4-b4ba-cef58ab2d7e8 None None] Releasing lock "compute-rpcapi-router" {{(pid=124683) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 10 11:33:08.181344 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-ec649b22-e230-44cf-a4d2-dfede8ab3f15 req-41bbdbab-8689-470a-a04c-9143a6a2c497 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:08.182315 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-ec649b22-e230-44cf-a4d2-dfede8ab3f15 req-41bbdbab-8689-470a-a04c-9143a6a2c497 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:08.182421 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-ec649b22-e230-44cf-a4d2-dfede8ab3f15 req-41bbdbab-8689-470a-a04c-9143a6a2c497 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:08.198624 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-6e8a0d97-3478-4bf4-b4ba-cef58ab2d7e8 None None] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.634763 Aug 10 11:33:08.200336 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 34/64] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:33:08.207161 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-a604dd5e-8a60-4113-8405-9d73860fb8c0 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:08.209639 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-a604dd5e-8a60-4113-8405-9d73860fb8c0 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:08.232526 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a604dd5e-8a60-4113-8405-9d73860fb8c0 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:08.234494 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a604dd5e-8a60-4113-8405-9d73860fb8c0 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:08.236412 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a604dd5e-8a60-4113-8405-9d73860fb8c0 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:08.237209 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a604dd5e-8a60-4113-8405-9d73860fb8c0 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:08.237680 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a604dd5e-8a60-4113-8405-9d73860fb8c0 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:08.241667 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a604dd5e-8a60-4113-8405-9d73860fb8c0 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:08.253732 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-ec649b22-e230-44cf-a4d2-dfede8ab3f15 req-41bbdbab-8689-470a-a04c-9143a6a2c497 service nova] Creating event network-changed:e488c9e1-d9f1-4e1f-8ee8-652d229c8978 for instance 85d76c52-fcda-4805-aa95-a00f88e39970 on hv-cinder-85272 Aug 10 11:33:08.256374 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-ec649b22-e230-44cf-a4d2-dfede8ab3f15 req-41bbdbab-8689-470a-a04c-9143a6a2c497 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=124682) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 10 11:33:08.281237 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-ec649b22-e230-44cf-a4d2-dfede8ab3f15 req-41bbdbab-8689-470a-a04c-9143a6a2c497 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124682) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 10 11:33:08.288187 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f35ab925-b2cf-40fb-98bd-98489f339ca1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:08.288703 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f35ab925-b2cf-40fb-98bd-98489f339ca1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:08.289162 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f35ab925-b2cf-40fb-98bd-98489f339ca1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:08.289927 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f35ab925-b2cf-40fb-98bd-98489f339ca1 None None] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:08.290394 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f35ab925-b2cf-40fb-98bd-98489f339ca1 None None] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:08.290832 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f35ab925-b2cf-40fb-98bd-98489f339ca1 None None] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:08.339619 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.compute.rpcapi [None req-f35ab925-b2cf-40fb-98bd-98489f339ca1 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 10 11:33:08.340558 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f35ab925-b2cf-40fb-98bd-98489f339ca1 None None] Releasing lock "compute-rpcapi-router" {{(pid=124682) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 10 11:33:08.404841 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-f35ab925-b2cf-40fb-98bd-98489f339ca1 None None] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.607835 Aug 10 11:33:08.408268 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 31/65] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:33:08.438034 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-60621134-5503-45f6-89c2-b5f2f9655351 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:08.438034 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-60621134-5503-45f6-89c2-b5f2f9655351 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:08.449178 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-60621134-5503-45f6-89c2-b5f2f9655351 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:08.449790 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-60621134-5503-45f6-89c2-b5f2f9655351 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:08.451401 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-60621134-5503-45f6-89c2-b5f2f9655351 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:08.460885 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-60621134-5503-45f6-89c2-b5f2f9655351 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:08.460885 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-60621134-5503-45f6-89c2-b5f2f9655351 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:08.461064 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-60621134-5503-45f6-89c2-b5f2f9655351 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:08.880154 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=32 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:33:09.028042 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-a604dd5e-8a60-4113-8405-9d73860fb8c0 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:09.040876 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-a604dd5e-8a60-4113-8405-9d73860fb8c0 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1361 microversion: 2.1 time: 0.838789 Aug 10 11:33:09.041780 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 35/66] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:08 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1361 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:09.050021 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-36e4e754-358c-4b38-8494-d900a27216fa tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:09.051035 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-36e4e754-358c-4b38-8494-d900a27216fa tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] [instance: 420b7baa-d100-4d8d-973f-3b29beebba6b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:09.086805 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-36e4e754-358c-4b38-8494-d900a27216fa tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:09.101703 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-36e4e754-358c-4b38-8494-d900a27216fa tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:09.101703 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-36e4e754-358c-4b38-8494-d900a27216fa tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:09.101703 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-36e4e754-358c-4b38-8494-d900a27216fa tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:09.101703 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-36e4e754-358c-4b38-8494-d900a27216fa tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:09.102061 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-36e4e754-358c-4b38-8494-d900a27216fa tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:09.246549 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-60621134-5503-45f6-89c2-b5f2f9655351 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:09.255680 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-60621134-5503-45f6-89c2-b5f2f9655351 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:09.261713 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-60621134-5503-45f6-89c2-b5f2f9655351 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:09.270421 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-60621134-5503-45f6-89c2-b5f2f9655351 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1406 microversion: 2.20 time: 0.853708 Aug 10 11:33:09.270421 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 32/67] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:33:08 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1406 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:33:09.278268 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-8869b711-4cb7-4ee8-b4a7-d60adb5feae6 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:09.279047 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-8869b711-4cb7-4ee8-b4a7-d60adb5feae6 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:09.302899 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8869b711-4cb7-4ee8-b4a7-d60adb5feae6 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:09.304894 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8869b711-4cb7-4ee8-b4a7-d60adb5feae6 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:09.305358 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8869b711-4cb7-4ee8-b4a7-d60adb5feae6 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:09.306088 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8869b711-4cb7-4ee8-b4a7-d60adb5feae6 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:09.306785 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8869b711-4cb7-4ee8-b4a7-d60adb5feae6 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:09.312140 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8869b711-4cb7-4ee8-b4a7-d60adb5feae6 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:09.845520 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-36e4e754-358c-4b38-8494-d900a27216fa tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12ec9d7cfec45ebbf390765794cbad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d79610ecd1460182af0946d8beba5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:09.857547 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-36e4e754-358c-4b38-8494-d900a27216fa tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] 10.222.0.62 "GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b" status: 200 len: 1315 microversion: 2.1 time: 0.812598 Aug 10 11:33:09.872724 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 36/68] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:09 2022] GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b => generated 1315 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:10.095068 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-2cf3ab37-2050-459e-83ab-98502d92391a tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:10.095824 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-2cf3ab37-2050-459e-83ab-98502d92391a tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:10.103023 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=5 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:33:10.106135 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2cf3ab37-2050-459e-83ab-98502d92391a tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:10.109244 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2cf3ab37-2050-459e-83ab-98502d92391a tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:10.109244 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2cf3ab37-2050-459e-83ab-98502d92391a tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:10.109935 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2cf3ab37-2050-459e-83ab-98502d92391a tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:10.114682 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2cf3ab37-2050-459e-83ab-98502d92391a tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:10.115401 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2cf3ab37-2050-459e-83ab-98502d92391a tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:10.126780 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-8869b711-4cb7-4ee8-b4a7-d60adb5feae6 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:10.149322 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-8869b711-4cb7-4ee8-b4a7-d60adb5feae6 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1321 microversion: 2.1 time: 0.880777 Aug 10 11:33:10.160890 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 33/69] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:09 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1321 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:10.170182 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=100 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:33:10.241611 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=22 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:33:10.267984 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-41262c5c-5a58-4b14-a1bb-ec8cea3cb9b7 req-7b84f3bc-49cf-4ecc-8e26-ed89cb0fd166 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e6ed242-956f-4b14-8520-18920447bf05", "tag": "f3f3926f-a2b3-40b5-a25f-a37b15cc0401"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:33:10.307831 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-41262c5c-5a58-4b14-a1bb-ec8cea3cb9b7 req-7b84f3bc-49cf-4ecc-8e26-ed89cb0fd166 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:10.310310 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-41262c5c-5a58-4b14-a1bb-ec8cea3cb9b7 req-7b84f3bc-49cf-4ecc-8e26-ed89cb0fd166 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:10.310310 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-41262c5c-5a58-4b14-a1bb-ec8cea3cb9b7 req-7b84f3bc-49cf-4ecc-8e26-ed89cb0fd166 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:10.321887 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-41262c5c-5a58-4b14-a1bb-ec8cea3cb9b7 req-7b84f3bc-49cf-4ecc-8e26-ed89cb0fd166 service nova] Creating event network-changed:f3f3926f-a2b3-40b5-a25f-a37b15cc0401 for instance 9e6ed242-956f-4b14-8520-18920447bf05 on hv-cinder-85272 Aug 10 11:33:10.330180 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-41262c5c-5a58-4b14-a1bb-ec8cea3cb9b7 req-7b84f3bc-49cf-4ecc-8e26-ed89cb0fd166 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074832 Aug 10 11:33:10.331435 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 34/70] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:33:10.337674 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-6be53d4b-cf4f-4220-8458-ec8cd5defcf4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:10.338773 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-6be53d4b-cf4f-4220-8458-ec8cd5defcf4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:10.347686 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6be53d4b-cf4f-4220-8458-ec8cd5defcf4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:10.348722 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6be53d4b-cf4f-4220-8458-ec8cd5defcf4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:10.349471 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6be53d4b-cf4f-4220-8458-ec8cd5defcf4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:10.350537 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6be53d4b-cf4f-4220-8458-ec8cd5defcf4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:10.351220 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6be53d4b-cf4f-4220-8458-ec8cd5defcf4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:10.351854 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6be53d4b-cf4f-4220-8458-ec8cd5defcf4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:10.453391 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-2cf3ab37-2050-459e-83ab-98502d92391a tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:10.462642 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-2cf3ab37-2050-459e-83ab-98502d92391a tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1361 microversion: 2.1 time: 0.373054 Aug 10 11:33:10.466772 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 37/71] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:10 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1361 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:33:10.523829 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-ffd897db-2ca1-46db-ab68-0925c7850a15 req-582130e2-94fa-4eba-bbc7-dd82fc6772e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23e6c8bd-1889-4c18-9580-0022eb962549", "tag": "8069a065-c0f3-4da4-a7ea-aadcc5bfe815"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:33:10.550557 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-ffd897db-2ca1-46db-ab68-0925c7850a15 req-582130e2-94fa-4eba-bbc7-dd82fc6772e4 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:10.550557 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-ffd897db-2ca1-46db-ab68-0925c7850a15 req-582130e2-94fa-4eba-bbc7-dd82fc6772e4 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:10.555051 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-ffd897db-2ca1-46db-ab68-0925c7850a15 req-582130e2-94fa-4eba-bbc7-dd82fc6772e4 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:10.593392 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-ffd897db-2ca1-46db-ab68-0925c7850a15 req-582130e2-94fa-4eba-bbc7-dd82fc6772e4 service nova] Creating event network-changed:8069a065-c0f3-4da4-a7ea-aadcc5bfe815 for instance 23e6c8bd-1889-4c18-9580-0022eb962549 on hv-cinder-85272 Aug 10 11:33:10.605605 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-ffd897db-2ca1-46db-ab68-0925c7850a15 req-582130e2-94fa-4eba-bbc7-dd82fc6772e4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085332 Aug 10 11:33:10.606977 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 38/72] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:33:10.895097 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-3f22e46a-23ad-4a7d-b62f-70b9d04100ea tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:10.897790 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-3f22e46a-23ad-4a7d-b62f-70b9d04100ea tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] [instance: 420b7baa-d100-4d8d-973f-3b29beebba6b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:10.903188 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3f22e46a-23ad-4a7d-b62f-70b9d04100ea tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:10.903687 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3f22e46a-23ad-4a7d-b62f-70b9d04100ea tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:10.905530 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3f22e46a-23ad-4a7d-b62f-70b9d04100ea tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:10.906491 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3f22e46a-23ad-4a7d-b62f-70b9d04100ea tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:10.907100 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3f22e46a-23ad-4a7d-b62f-70b9d04100ea tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:10.908245 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3f22e46a-23ad-4a7d-b62f-70b9d04100ea tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:10.937473 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-6be53d4b-cf4f-4220-8458-ec8cd5defcf4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:10.965868 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-6be53d4b-cf4f-4220-8458-ec8cd5defcf4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:10.969876 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-6be53d4b-cf4f-4220-8458-ec8cd5defcf4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:10.974030 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-6be53d4b-cf4f-4220-8458-ec8cd5defcf4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1406 microversion: 2.20 time: 0.641271 Aug 10 11:33:10.976957 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 35/73] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:33:10 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1406 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:33:11.174149 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-73170196-850d-40d0-9513-83ab941342d2 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:11.175682 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-73170196-850d-40d0-9513-83ab941342d2 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:11.192862 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-73170196-850d-40d0-9513-83ab941342d2 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:11.193828 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-73170196-850d-40d0-9513-83ab941342d2 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:11.194723 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-73170196-850d-40d0-9513-83ab941342d2 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:11.198779 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-73170196-850d-40d0-9513-83ab941342d2 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:11.199655 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-73170196-850d-40d0-9513-83ab941342d2 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:11.201499 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-73170196-850d-40d0-9513-83ab941342d2 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:11.661014 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-3f22e46a-23ad-4a7d-b62f-70b9d04100ea tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12ec9d7cfec45ebbf390765794cbad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d79610ecd1460182af0946d8beba5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:11.673258 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-3f22e46a-23ad-4a7d-b62f-70b9d04100ea tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] 10.222.0.62 "GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b" status: 200 len: 1315 microversion: 2.1 time: 0.779733 Aug 10 11:33:11.676107 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 39/74] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:10 2022] GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b => generated 1315 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:33:11.687594 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-3295ed68-13ba-4162-8f44-88b62e72b69c tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:11.688742 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-3295ed68-13ba-4162-8f44-88b62e72b69c tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:11.703159 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3295ed68-13ba-4162-8f44-88b62e72b69c tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:11.704857 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3295ed68-13ba-4162-8f44-88b62e72b69c tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:11.706674 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3295ed68-13ba-4162-8f44-88b62e72b69c tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:11.708835 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3295ed68-13ba-4162-8f44-88b62e72b69c tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:11.709834 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3295ed68-13ba-4162-8f44-88b62e72b69c tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:11.711608 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3295ed68-13ba-4162-8f44-88b62e72b69c tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:11.922947 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-73170196-850d-40d0-9513-83ab941342d2 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:11.938182 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-73170196-850d-40d0-9513-83ab941342d2 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1321 microversion: 2.1 time: 0.768572 Aug 10 11:33:11.953638 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 36/75] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:11 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1321 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:33:12.005624 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-4a91b38f-69fe-4193-8d79-16c6d3727470 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:12.005624 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-4a91b38f-69fe-4193-8d79-16c6d3727470 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:12.009561 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4a91b38f-69fe-4193-8d79-16c6d3727470 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:12.010296 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4a91b38f-69fe-4193-8d79-16c6d3727470 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:12.010919 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-3295ed68-13ba-4162-8f44-88b62e72b69c tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:12.011131 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4a91b38f-69fe-4193-8d79-16c6d3727470 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:12.012208 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4a91b38f-69fe-4193-8d79-16c6d3727470 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:12.017586 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4a91b38f-69fe-4193-8d79-16c6d3727470 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:12.018242 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4a91b38f-69fe-4193-8d79-16c6d3727470 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:12.025850 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-3295ed68-13ba-4162-8f44-88b62e72b69c tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1361 microversion: 2.1 time: 0.344566 Aug 10 11:33:12.026481 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 40/76] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:11 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1361 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:12.233174 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-4a91b38f-69fe-4193-8d79-16c6d3727470 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:12.241717 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-4a91b38f-69fe-4193-8d79-16c6d3727470 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:12.243307 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-4a91b38f-69fe-4193-8d79-16c6d3727470 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:12.244435 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-4a91b38f-69fe-4193-8d79-16c6d3727470 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1406 microversion: 2.20 time: 0.249529 Aug 10 11:33:12.246090 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 37/77] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:33:11 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1406 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:33:12.699549 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-df48ba5f-e23f-42fc-86f3-1fbda5165cd8 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:12.700810 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-df48ba5f-e23f-42fc-86f3-1fbda5165cd8 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] [instance: 420b7baa-d100-4d8d-973f-3b29beebba6b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:12.711169 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-df48ba5f-e23f-42fc-86f3-1fbda5165cd8 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:12.716273 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-df48ba5f-e23f-42fc-86f3-1fbda5165cd8 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:12.716884 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-df48ba5f-e23f-42fc-86f3-1fbda5165cd8 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:12.718326 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-df48ba5f-e23f-42fc-86f3-1fbda5165cd8 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:12.718941 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-df48ba5f-e23f-42fc-86f3-1fbda5165cd8 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:12.720305 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-df48ba5f-e23f-42fc-86f3-1fbda5165cd8 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:12.745543 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-d8e3529c-5074-4800-9397-3fe921b95b50 req-2a78a56c-0266-459f-9138-80c2d9e6230d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61282604-5de4-413b-be4c-80aadca981b3", "tag": "6a87af65-add0-4b0b-b0e4-e0ac69cae1fd"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:33:12.761471 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-d8e3529c-5074-4800-9397-3fe921b95b50 req-2a78a56c-0266-459f-9138-80c2d9e6230d service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:12.762689 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-d8e3529c-5074-4800-9397-3fe921b95b50 req-2a78a56c-0266-459f-9138-80c2d9e6230d service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:12.763954 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-d8e3529c-5074-4800-9397-3fe921b95b50 req-2a78a56c-0266-459f-9138-80c2d9e6230d service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:12.777671 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=100 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:33:12.780991 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-d8e3529c-5074-4800-9397-3fe921b95b50 req-2a78a56c-0266-459f-9138-80c2d9e6230d service nova] Creating event network-changed:6a87af65-add0-4b0b-b0e4-e0ac69cae1fd for instance 61282604-5de4-413b-be4c-80aadca981b3 on hv-cinder-85272 Aug 10 11:33:12.801344 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-d8e3529c-5074-4800-9397-3fe921b95b50 req-2a78a56c-0266-459f-9138-80c2d9e6230d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059243 Aug 10 11:33:12.802642 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 38/78] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:33:12.910314 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-df48ba5f-e23f-42fc-86f3-1fbda5165cd8 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12ec9d7cfec45ebbf390765794cbad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d79610ecd1460182af0946d8beba5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:12.918752 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-df48ba5f-e23f-42fc-86f3-1fbda5165cd8 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] 10.222.0.62 "GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b" status: 200 len: 1315 microversion: 2.1 time: 0.223532 Aug 10 11:33:12.919330 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 41/79] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:12 2022] GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:12.963094 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-88a88c71-988b-48e9-8bf0-3e0f78a6001c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:12.963787 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-88a88c71-988b-48e9-8bf0-3e0f78a6001c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:12.970035 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-88a88c71-988b-48e9-8bf0-3e0f78a6001c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:12.972821 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-88a88c71-988b-48e9-8bf0-3e0f78a6001c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:12.972821 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-88a88c71-988b-48e9-8bf0-3e0f78a6001c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:12.972821 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-88a88c71-988b-48e9-8bf0-3e0f78a6001c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:12.972821 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-88a88c71-988b-48e9-8bf0-3e0f78a6001c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:12.973333 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-88a88c71-988b-48e9-8bf0-3e0f78a6001c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:13.047523 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-38f110a7-4989-48b5-97b0-889acaacd3b5 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:13.048329 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-38f110a7-4989-48b5-97b0-889acaacd3b5 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:13.055279 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-38f110a7-4989-48b5-97b0-889acaacd3b5 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:13.056487 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-38f110a7-4989-48b5-97b0-889acaacd3b5 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:13.057526 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-38f110a7-4989-48b5-97b0-889acaacd3b5 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:13.065349 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-38f110a7-4989-48b5-97b0-889acaacd3b5 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:13.066265 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-38f110a7-4989-48b5-97b0-889acaacd3b5 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:13.070600 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-38f110a7-4989-48b5-97b0-889acaacd3b5 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:13.128184 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-88a88c71-988b-48e9-8bf0-3e0f78a6001c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:13.135949 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-88a88c71-988b-48e9-8bf0-3e0f78a6001c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1321 microversion: 2.1 time: 0.177025 Aug 10 11:33:13.137197 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 39/80] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:12 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:13.224297 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-38f110a7-4989-48b5-97b0-889acaacd3b5 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:13.231837 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-38f110a7-4989-48b5-97b0-889acaacd3b5 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1361 microversion: 2.1 time: 0.188052 Aug 10 11:33:13.232439 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 42/81] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:13 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1361 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:13.267700 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-a6110e59-d5ea-4a50-b7a5-6d57ff7a813a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:13.268333 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-a6110e59-d5ea-4a50-b7a5-6d57ff7a813a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:13.274588 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a6110e59-d5ea-4a50-b7a5-6d57ff7a813a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:13.275066 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a6110e59-d5ea-4a50-b7a5-6d57ff7a813a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:13.275496 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a6110e59-d5ea-4a50-b7a5-6d57ff7a813a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:13.276359 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a6110e59-d5ea-4a50-b7a5-6d57ff7a813a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:13.276782 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a6110e59-d5ea-4a50-b7a5-6d57ff7a813a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:13.277205 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a6110e59-d5ea-4a50-b7a5-6d57ff7a813a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:13.434553 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-a6110e59-d5ea-4a50-b7a5-6d57ff7a813a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:13.443134 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-a6110e59-d5ea-4a50-b7a5-6d57ff7a813a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:13.444689 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-a6110e59-d5ea-4a50-b7a5-6d57ff7a813a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:13.445780 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-a6110e59-d5ea-4a50-b7a5-6d57ff7a813a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1406 microversion: 2.20 time: 0.183031 Aug 10 11:33:13.446339 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 40/82] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:33:13 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:33:13.940069 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-54101bcd-7d1b-454a-ac21-30e2288af700 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:13.945841 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-54101bcd-7d1b-454a-ac21-30e2288af700 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] [instance: 420b7baa-d100-4d8d-973f-3b29beebba6b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:13.947260 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-54101bcd-7d1b-454a-ac21-30e2288af700 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:13.947818 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-54101bcd-7d1b-454a-ac21-30e2288af700 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:13.948460 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-54101bcd-7d1b-454a-ac21-30e2288af700 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:13.949286 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-54101bcd-7d1b-454a-ac21-30e2288af700 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:13.949886 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-54101bcd-7d1b-454a-ac21-30e2288af700 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:13.950446 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-54101bcd-7d1b-454a-ac21-30e2288af700 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:14.105680 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-54101bcd-7d1b-454a-ac21-30e2288af700 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12ec9d7cfec45ebbf390765794cbad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d79610ecd1460182af0946d8beba5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:14.109652 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-54101bcd-7d1b-454a-ac21-30e2288af700 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] 10.222.0.62 "GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b" status: 200 len: 1315 microversion: 2.1 time: 0.174354 Aug 10 11:33:14.110226 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 43/83] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:13 2022] GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:14.158626 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-b7cc2bff-ddf2-4cca-9583-15763f385ca5 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:14.159172 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-b7cc2bff-ddf2-4cca-9583-15763f385ca5 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:14.165847 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b7cc2bff-ddf2-4cca-9583-15763f385ca5 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:14.166541 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b7cc2bff-ddf2-4cca-9583-15763f385ca5 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:14.166991 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b7cc2bff-ddf2-4cca-9583-15763f385ca5 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:14.167696 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b7cc2bff-ddf2-4cca-9583-15763f385ca5 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:14.168186 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b7cc2bff-ddf2-4cca-9583-15763f385ca5 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:14.168620 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b7cc2bff-ddf2-4cca-9583-15763f385ca5 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:14.254515 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-a64d8a59-4e4f-4660-921c-8c520505115e tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:14.255128 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-a64d8a59-4e4f-4660-921c-8c520505115e tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:14.267358 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a64d8a59-4e4f-4660-921c-8c520505115e tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:14.268356 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a64d8a59-4e4f-4660-921c-8c520505115e tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:14.268356 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a64d8a59-4e4f-4660-921c-8c520505115e tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:14.269005 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a64d8a59-4e4f-4660-921c-8c520505115e tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:14.269626 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a64d8a59-4e4f-4660-921c-8c520505115e tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:14.270211 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a64d8a59-4e4f-4660-921c-8c520505115e tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:14.370566 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b7cc2bff-ddf2-4cca-9583-15763f385ca5 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:14.380367 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-b7cc2bff-ddf2-4cca-9583-15763f385ca5 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1321 microversion: 2.1 time: 0.226198 Aug 10 11:33:14.382084 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 41/84] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:14 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1321 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:14.471103 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-e7626024-80c6-403c-bbf1-c70d5a20900d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:14.472001 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-e7626024-80c6-403c-bbf1-c70d5a20900d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:14.478701 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e7626024-80c6-403c-bbf1-c70d5a20900d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:14.479490 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e7626024-80c6-403c-bbf1-c70d5a20900d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:14.480408 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e7626024-80c6-403c-bbf1-c70d5a20900d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:14.481143 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e7626024-80c6-403c-bbf1-c70d5a20900d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:14.481590 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e7626024-80c6-403c-bbf1-c70d5a20900d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:14.485148 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e7626024-80c6-403c-bbf1-c70d5a20900d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:14.566957 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-a64d8a59-4e4f-4660-921c-8c520505115e tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:14.582905 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-a64d8a59-4e4f-4660-921c-8c520505115e tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1361 microversion: 2.1 time: 0.332307 Aug 10 11:33:14.583848 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 44/85] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:14 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1361 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:33:14.628697 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-e7626024-80c6-403c-bbf1-c70d5a20900d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:14.636497 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-e7626024-80c6-403c-bbf1-c70d5a20900d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:14.638052 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-e7626024-80c6-403c-bbf1-c70d5a20900d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:14.640083 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-e7626024-80c6-403c-bbf1-c70d5a20900d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1406 microversion: 2.20 time: 0.172971 Aug 10 11:33:14.641006 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 42/86] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:33:14 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:33:15.131132 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-75470c2b-edfe-4ec1-ac3d-5302241b26d8 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:15.131738 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-75470c2b-edfe-4ec1-ac3d-5302241b26d8 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] [instance: 420b7baa-d100-4d8d-973f-3b29beebba6b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:15.137768 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-75470c2b-edfe-4ec1-ac3d-5302241b26d8 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:15.138236 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-75470c2b-edfe-4ec1-ac3d-5302241b26d8 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:15.138682 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-75470c2b-edfe-4ec1-ac3d-5302241b26d8 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:15.140477 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-75470c2b-edfe-4ec1-ac3d-5302241b26d8 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:15.141142 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-75470c2b-edfe-4ec1-ac3d-5302241b26d8 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:15.141570 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-75470c2b-edfe-4ec1-ac3d-5302241b26d8 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:15.272317 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-75470c2b-edfe-4ec1-ac3d-5302241b26d8 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12ec9d7cfec45ebbf390765794cbad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d79610ecd1460182af0946d8beba5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:15.280447 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-75470c2b-edfe-4ec1-ac3d-5302241b26d8 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] 10.222.0.62 "GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b" status: 200 len: 1315 microversion: 2.1 time: 0.152809 Aug 10 11:33:15.281044 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 45/87] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:15 2022] GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:15.402632 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-7c874942-8e85-479e-a8eb-e0a8c571d0d1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:15.403238 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-7c874942-8e85-479e-a8eb-e0a8c571d0d1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:15.409837 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7c874942-8e85-479e-a8eb-e0a8c571d0d1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:15.410505 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7c874942-8e85-479e-a8eb-e0a8c571d0d1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:15.411224 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7c874942-8e85-479e-a8eb-e0a8c571d0d1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:15.412309 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7c874942-8e85-479e-a8eb-e0a8c571d0d1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:15.413125 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7c874942-8e85-479e-a8eb-e0a8c571d0d1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:15.413879 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7c874942-8e85-479e-a8eb-e0a8c571d0d1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:15.547486 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-7c874942-8e85-479e-a8eb-e0a8c571d0d1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:15.555151 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-7c874942-8e85-479e-a8eb-e0a8c571d0d1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1321 microversion: 2.1 time: 0.156537 Aug 10 11:33:15.565864 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 43/88] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:15 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:15.603917 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f9936153-f409-475e-93c4-718f41a61c80 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:15.604991 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-f9936153-f409-475e-93c4-718f41a61c80 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:15.612050 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f9936153-f409-475e-93c4-718f41a61c80 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:15.612472 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f9936153-f409-475e-93c4-718f41a61c80 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:15.613560 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f9936153-f409-475e-93c4-718f41a61c80 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:15.615475 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f9936153-f409-475e-93c4-718f41a61c80 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:15.616123 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f9936153-f409-475e-93c4-718f41a61c80 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:15.616702 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f9936153-f409-475e-93c4-718f41a61c80 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:15.672388 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-80b5226d-293a-4eac-be87-4ad7d5ddffe0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:15.672388 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-80b5226d-293a-4eac-be87-4ad7d5ddffe0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:15.675479 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-80b5226d-293a-4eac-be87-4ad7d5ddffe0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:15.676197 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-80b5226d-293a-4eac-be87-4ad7d5ddffe0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:15.676634 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-80b5226d-293a-4eac-be87-4ad7d5ddffe0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:15.677362 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-80b5226d-293a-4eac-be87-4ad7d5ddffe0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:15.677819 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-80b5226d-293a-4eac-be87-4ad7d5ddffe0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:15.678241 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-80b5226d-293a-4eac-be87-4ad7d5ddffe0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:15.774946 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-f9936153-f409-475e-93c4-718f41a61c80 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:15.788185 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-f9936153-f409-475e-93c4-718f41a61c80 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1361 microversion: 2.1 time: 0.188052 Aug 10 11:33:15.789503 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 46/89] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:15 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1361 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:15.851916 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-80b5226d-293a-4eac-be87-4ad7d5ddffe0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:15.860307 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-80b5226d-293a-4eac-be87-4ad7d5ddffe0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:15.861804 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-80b5226d-293a-4eac-be87-4ad7d5ddffe0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:15.862943 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-80b5226d-293a-4eac-be87-4ad7d5ddffe0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1406 microversion: 2.20 time: 0.204473 Aug 10 11:33:15.863495 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 44/90] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:33:15 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1406 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:33:16.302046 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f7d12a89-3ed5-4bcf-8f61-65d123e832fa tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:16.302691 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-f7d12a89-3ed5-4bcf-8f61-65d123e832fa tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] [instance: 420b7baa-d100-4d8d-973f-3b29beebba6b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:16.308645 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f7d12a89-3ed5-4bcf-8f61-65d123e832fa tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:16.309145 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f7d12a89-3ed5-4bcf-8f61-65d123e832fa tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:16.309571 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f7d12a89-3ed5-4bcf-8f61-65d123e832fa tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:16.310305 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f7d12a89-3ed5-4bcf-8f61-65d123e832fa tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:16.310785 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f7d12a89-3ed5-4bcf-8f61-65d123e832fa tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:16.312092 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f7d12a89-3ed5-4bcf-8f61-65d123e832fa tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:16.443725 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-f7d12a89-3ed5-4bcf-8f61-65d123e832fa tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12ec9d7cfec45ebbf390765794cbad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d79610ecd1460182af0946d8beba5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:16.454923 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-f7d12a89-3ed5-4bcf-8f61-65d123e832fa tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] 10.222.0.62 "GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b" status: 200 len: 1315 microversion: 2.1 time: 0.156456 Aug 10 11:33:16.455806 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 47/91] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:16 2022] GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:16.578006 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-9bd5dc21-fd69-42f6-b5cd-bdb8ee02caa7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:16.578617 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-9bd5dc21-fd69-42f6-b5cd-bdb8ee02caa7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:16.584758 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9bd5dc21-fd69-42f6-b5cd-bdb8ee02caa7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:16.585235 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9bd5dc21-fd69-42f6-b5cd-bdb8ee02caa7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:16.585673 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9bd5dc21-fd69-42f6-b5cd-bdb8ee02caa7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:16.586648 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9bd5dc21-fd69-42f6-b5cd-bdb8ee02caa7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:16.586790 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9bd5dc21-fd69-42f6-b5cd-bdb8ee02caa7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:16.587209 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9bd5dc21-fd69-42f6-b5cd-bdb8ee02caa7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:16.723572 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-9bd5dc21-fd69-42f6-b5cd-bdb8ee02caa7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:16.731119 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-9bd5dc21-fd69-42f6-b5cd-bdb8ee02caa7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1321 microversion: 2.1 time: 0.157859 Aug 10 11:33:16.731675 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 45/92] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:16 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:16.809711 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-720fed3d-ff56-4d02-8008-2239058ddd42 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:16.810503 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-720fed3d-ff56-4d02-8008-2239058ddd42 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:16.817254 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-720fed3d-ff56-4d02-8008-2239058ddd42 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:16.820134 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-720fed3d-ff56-4d02-8008-2239058ddd42 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:16.820134 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-720fed3d-ff56-4d02-8008-2239058ddd42 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:16.820134 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-720fed3d-ff56-4d02-8008-2239058ddd42 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:16.820134 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-720fed3d-ff56-4d02-8008-2239058ddd42 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:16.820512 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-720fed3d-ff56-4d02-8008-2239058ddd42 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:16.886329 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-9e4f5eec-5445-4986-9a19-f83ba2c7eb9b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:16.886944 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-9e4f5eec-5445-4986-9a19-f83ba2c7eb9b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:16.893361 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9e4f5eec-5445-4986-9a19-f83ba2c7eb9b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:16.893847 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9e4f5eec-5445-4986-9a19-f83ba2c7eb9b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:16.894286 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9e4f5eec-5445-4986-9a19-f83ba2c7eb9b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:16.894982 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9e4f5eec-5445-4986-9a19-f83ba2c7eb9b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:16.895432 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9e4f5eec-5445-4986-9a19-f83ba2c7eb9b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:16.895856 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9e4f5eec-5445-4986-9a19-f83ba2c7eb9b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:16.949966 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-720fed3d-ff56-4d02-8008-2239058ddd42 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:16.958090 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-720fed3d-ff56-4d02-8008-2239058ddd42 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1361 microversion: 2.1 time: 0.152172 Aug 10 11:33:16.958657 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 48/93] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:16 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:17.031422 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-9e4f5eec-5445-4986-9a19-f83ba2c7eb9b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:17.039360 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-9e4f5eec-5445-4986-9a19-f83ba2c7eb9b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:17.040895 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-9e4f5eec-5445-4986-9a19-f83ba2c7eb9b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:17.041995 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-9e4f5eec-5445-4986-9a19-f83ba2c7eb9b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1406 microversion: 2.20 time: 0.159714 Aug 10 11:33:17.042548 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 46/94] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:33:16 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:33:17.476148 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-341dba25-ba03-4ba1-866a-4eedc3f272ca tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:17.476746 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-341dba25-ba03-4ba1-866a-4eedc3f272ca tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] [instance: 420b7baa-d100-4d8d-973f-3b29beebba6b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:17.484243 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-341dba25-ba03-4ba1-866a-4eedc3f272ca tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:17.484728 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-341dba25-ba03-4ba1-866a-4eedc3f272ca tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:17.487542 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-341dba25-ba03-4ba1-866a-4eedc3f272ca tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:17.487542 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-341dba25-ba03-4ba1-866a-4eedc3f272ca tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:17.487542 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-341dba25-ba03-4ba1-866a-4eedc3f272ca tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:17.487542 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-341dba25-ba03-4ba1-866a-4eedc3f272ca tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:17.623178 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-341dba25-ba03-4ba1-866a-4eedc3f272ca tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12ec9d7cfec45ebbf390765794cbad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d79610ecd1460182af0946d8beba5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:17.631380 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-341dba25-ba03-4ba1-866a-4eedc3f272ca tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] 10.222.0.62 "GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b" status: 200 len: 1315 microversion: 2.1 time: 0.159211 Aug 10 11:33:17.631935 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 49/95] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:17 2022] GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:17.753758 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-e3b0be60-8b4a-493d-9368-08750aa15810 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:17.755053 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-e3b0be60-8b4a-493d-9368-08750aa15810 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:17.761642 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e3b0be60-8b4a-493d-9368-08750aa15810 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:17.762203 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e3b0be60-8b4a-493d-9368-08750aa15810 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:17.762816 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e3b0be60-8b4a-493d-9368-08750aa15810 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:17.763565 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e3b0be60-8b4a-493d-9368-08750aa15810 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:17.764362 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e3b0be60-8b4a-493d-9368-08750aa15810 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:17.764932 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e3b0be60-8b4a-493d-9368-08750aa15810 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:17.928255 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-e3b0be60-8b4a-493d-9368-08750aa15810 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:17.940154 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-e3b0be60-8b4a-493d-9368-08750aa15810 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1321 microversion: 2.1 time: 0.191187 Aug 10 11:33:17.942136 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 47/96] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:17 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1321 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:17.978931 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-ce6dbec7-dccc-4f4f-a65b-7fef9d136ce3 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:17.979652 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-ce6dbec7-dccc-4f4f-a65b-7fef9d136ce3 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:17.986871 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ce6dbec7-dccc-4f4f-a65b-7fef9d136ce3 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:17.992243 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ce6dbec7-dccc-4f4f-a65b-7fef9d136ce3 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:17.992243 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ce6dbec7-dccc-4f4f-a65b-7fef9d136ce3 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:17.992243 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ce6dbec7-dccc-4f4f-a65b-7fef9d136ce3 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:17.992243 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ce6dbec7-dccc-4f4f-a65b-7fef9d136ce3 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:17.992591 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ce6dbec7-dccc-4f4f-a65b-7fef9d136ce3 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:18.067737 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-fa6fcace-800e-4cb5-9a7e-e86d34082bea tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:18.068498 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-fa6fcace-800e-4cb5-9a7e-e86d34082bea tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:18.078633 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fa6fcace-800e-4cb5-9a7e-e86d34082bea tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:18.078633 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fa6fcace-800e-4cb5-9a7e-e86d34082bea tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:18.078633 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fa6fcace-800e-4cb5-9a7e-e86d34082bea tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:18.078633 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fa6fcace-800e-4cb5-9a7e-e86d34082bea tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:18.079009 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fa6fcace-800e-4cb5-9a7e-e86d34082bea tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:18.079009 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fa6fcace-800e-4cb5-9a7e-e86d34082bea tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:18.144350 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=2 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:33:18.157125 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-ce6dbec7-dccc-4f4f-a65b-7fef9d136ce3 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:18.177995 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-ce6dbec7-dccc-4f4f-a65b-7fef9d136ce3 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1361 microversion: 2.1 time: 0.202649 Aug 10 11:33:18.179522 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 50/97] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:17 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1361 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:18.255628 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-fa6fcace-800e-4cb5-9a7e-e86d34082bea tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:18.262518 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-fa6fcace-800e-4cb5-9a7e-e86d34082bea tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:18.265659 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-fa6fcace-800e-4cb5-9a7e-e86d34082bea tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:18.267446 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-fa6fcace-800e-4cb5-9a7e-e86d34082bea tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1406 microversion: 2.20 time: 0.205995 Aug 10 11:33:18.271742 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 48/98] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:33:18 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1406 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:33:18.652604 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-df55c87f-28d6-428c-8163-f56e52b70333 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:18.653215 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-df55c87f-28d6-428c-8163-f56e52b70333 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] [instance: 420b7baa-d100-4d8d-973f-3b29beebba6b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:18.660422 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-df55c87f-28d6-428c-8163-f56e52b70333 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:18.660948 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-df55c87f-28d6-428c-8163-f56e52b70333 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:18.661388 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-df55c87f-28d6-428c-8163-f56e52b70333 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:18.662088 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-df55c87f-28d6-428c-8163-f56e52b70333 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:18.662545 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-df55c87f-28d6-428c-8163-f56e52b70333 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:18.662975 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-df55c87f-28d6-428c-8163-f56e52b70333 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:18.795377 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-df55c87f-28d6-428c-8163-f56e52b70333 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12ec9d7cfec45ebbf390765794cbad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d79610ecd1460182af0946d8beba5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:18.802838 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-df55c87f-28d6-428c-8163-f56e52b70333 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] 10.222.0.62 "GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b" status: 200 len: 1315 microversion: 2.1 time: 0.154185 Aug 10 11:33:18.803413 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 51/99] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:18 2022] GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:18.975101 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-a5792a39-00d9-4148-8174-f0a41a36f4ed tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:18.976284 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-a5792a39-00d9-4148-8174-f0a41a36f4ed tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:18.982509 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a5792a39-00d9-4148-8174-f0a41a36f4ed tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:18.984298 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a5792a39-00d9-4148-8174-f0a41a36f4ed tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:18.984741 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a5792a39-00d9-4148-8174-f0a41a36f4ed tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:18.985466 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a5792a39-00d9-4148-8174-f0a41a36f4ed tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:18.985920 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a5792a39-00d9-4148-8174-f0a41a36f4ed tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:18.986514 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a5792a39-00d9-4148-8174-f0a41a36f4ed tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:19.133314 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-a5792a39-00d9-4148-8174-f0a41a36f4ed tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:19.148005 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-a5792a39-00d9-4148-8174-f0a41a36f4ed tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1321 microversion: 2.1 time: 0.178249 Aug 10 11:33:19.160134 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 49/100] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:18 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:19.205150 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-2469edeb-ea08-4dc3-bd09-31a02ef174af tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:19.205150 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-2469edeb-ea08-4dc3-bd09-31a02ef174af tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:19.214144 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2469edeb-ea08-4dc3-bd09-31a02ef174af tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:19.215029 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2469edeb-ea08-4dc3-bd09-31a02ef174af tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:19.215705 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2469edeb-ea08-4dc3-bd09-31a02ef174af tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:19.217740 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2469edeb-ea08-4dc3-bd09-31a02ef174af tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:19.218685 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2469edeb-ea08-4dc3-bd09-31a02ef174af tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:19.219284 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2469edeb-ea08-4dc3-bd09-31a02ef174af tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:19.288762 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-3d073bfb-aa89-461d-b684-6255e2584e70 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:19.289650 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-3d073bfb-aa89-461d-b684-6255e2584e70 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:19.296556 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3d073bfb-aa89-461d-b684-6255e2584e70 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:19.297221 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3d073bfb-aa89-461d-b684-6255e2584e70 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:19.298362 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3d073bfb-aa89-461d-b684-6255e2584e70 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:19.299357 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3d073bfb-aa89-461d-b684-6255e2584e70 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:19.300095 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3d073bfb-aa89-461d-b684-6255e2584e70 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:19.300679 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3d073bfb-aa89-461d-b684-6255e2584e70 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:19.413393 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-2469edeb-ea08-4dc3-bd09-31a02ef174af tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:19.422160 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-2469edeb-ea08-4dc3-bd09-31a02ef174af tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1361 microversion: 2.1 time: 0.223889 Aug 10 11:33:19.422725 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 52/101] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:19 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1361 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:19.548344 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-3d073bfb-aa89-461d-b684-6255e2584e70 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:19.556644 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-3d073bfb-aa89-461d-b684-6255e2584e70 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:19.558449 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-3d073bfb-aa89-461d-b684-6255e2584e70 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:19.564526 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-3d073bfb-aa89-461d-b684-6255e2584e70 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1406 microversion: 2.20 time: 0.275050 Aug 10 11:33:19.564526 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 50/102] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:33:19 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1406 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:33:19.823023 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-a22cf39b-068b-4325-8f25-8de80209bd71 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:19.827361 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-a22cf39b-068b-4325-8f25-8de80209bd71 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] [instance: 420b7baa-d100-4d8d-973f-3b29beebba6b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:19.830303 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a22cf39b-068b-4325-8f25-8de80209bd71 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:19.830785 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a22cf39b-068b-4325-8f25-8de80209bd71 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:19.831222 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a22cf39b-068b-4325-8f25-8de80209bd71 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:19.831914 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a22cf39b-068b-4325-8f25-8de80209bd71 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:19.832396 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a22cf39b-068b-4325-8f25-8de80209bd71 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:19.832818 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a22cf39b-068b-4325-8f25-8de80209bd71 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:19.977496 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-a22cf39b-068b-4325-8f25-8de80209bd71 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12ec9d7cfec45ebbf390765794cbad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d79610ecd1460182af0946d8beba5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:19.989187 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-a22cf39b-068b-4325-8f25-8de80209bd71 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] 10.222.0.62 "GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b" status: 200 len: 1315 microversion: 2.1 time: 0.169844 Aug 10 11:33:19.989981 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 53/103] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:19 2022] GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:20.172313 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-b19fe4d3-2c12-4d2d-ab29-cb6c93932593 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:20.173074 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-b19fe4d3-2c12-4d2d-ab29-cb6c93932593 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:20.175133 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=2 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:33:20.185171 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b19fe4d3-2c12-4d2d-ab29-cb6c93932593 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:20.192484 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b19fe4d3-2c12-4d2d-ab29-cb6c93932593 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:20.196799 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b19fe4d3-2c12-4d2d-ab29-cb6c93932593 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:20.197875 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b19fe4d3-2c12-4d2d-ab29-cb6c93932593 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:20.198501 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b19fe4d3-2c12-4d2d-ab29-cb6c93932593 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:20.198933 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b19fe4d3-2c12-4d2d-ab29-cb6c93932593 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:20.350154 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b19fe4d3-2c12-4d2d-ab29-cb6c93932593 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:20.361242 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-b19fe4d3-2c12-4d2d-ab29-cb6c93932593 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1321 microversion: 2.1 time: 0.193014 Aug 10 11:33:20.361848 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 51/104] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:20 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1321 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:20.451298 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-efd97159-b731-4fa9-bff3-b81239edd28b tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:20.452553 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-efd97159-b731-4fa9-bff3-b81239edd28b tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:20.458918 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-efd97159-b731-4fa9-bff3-b81239edd28b tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:20.459875 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-efd97159-b731-4fa9-bff3-b81239edd28b tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:20.460418 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-efd97159-b731-4fa9-bff3-b81239edd28b tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:20.461509 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-efd97159-b731-4fa9-bff3-b81239edd28b tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:20.461974 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-efd97159-b731-4fa9-bff3-b81239edd28b tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:20.462403 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-efd97159-b731-4fa9-bff3-b81239edd28b tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:20.643927 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-efd97159-b731-4fa9-bff3-b81239edd28b tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:20.648358 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=100 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:33:20.656516 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-efd97159-b731-4fa9-bff3-b81239edd28b tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1361 microversion: 2.1 time: 0.208923 Aug 10 11:33:20.658225 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 54/105] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:20 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1361 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:20.676046 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-f0c0424e-58b1-453c-97ff-67bc1d6735d8 req-f79f84fd-0ab4-4d66-8fc5-948018877158 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85d76c52-fcda-4805-aa95-a00f88e39970", "name": "network-vif-plugged", "status": "completed", "tag": "e488c9e1-d9f1-4e1f-8ee8-652d229c8978"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:33:20.680204 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-6d5eaca3-df1a-4e02-8ef9-9cf00161d2b3 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:20.681314 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-6d5eaca3-df1a-4e02-8ef9-9cf00161d2b3 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:20.688345 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6d5eaca3-df1a-4e02-8ef9-9cf00161d2b3 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:20.689082 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6d5eaca3-df1a-4e02-8ef9-9cf00161d2b3 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:20.689315 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-f0c0424e-58b1-453c-97ff-67bc1d6735d8 req-f79f84fd-0ab4-4d66-8fc5-948018877158 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:20.689848 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-f0c0424e-58b1-453c-97ff-67bc1d6735d8 req-f79f84fd-0ab4-4d66-8fc5-948018877158 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:20.690316 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6d5eaca3-df1a-4e02-8ef9-9cf00161d2b3 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:20.690443 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-f0c0424e-58b1-453c-97ff-67bc1d6735d8 req-f79f84fd-0ab4-4d66-8fc5-948018877158 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:20.691596 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6d5eaca3-df1a-4e02-8ef9-9cf00161d2b3 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:20.692318 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6d5eaca3-df1a-4e02-8ef9-9cf00161d2b3 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:20.693153 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6d5eaca3-df1a-4e02-8ef9-9cf00161d2b3 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:20.706818 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-f0c0424e-58b1-453c-97ff-67bc1d6735d8 req-f79f84fd-0ab4-4d66-8fc5-948018877158 service nova] Creating event network-vif-plugged:e488c9e1-d9f1-4e1f-8ee8-652d229c8978 for instance 85d76c52-fcda-4805-aa95-a00f88e39970 on hv-cinder-85272 Aug 10 11:33:20.719718 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-f0c0424e-58b1-453c-97ff-67bc1d6735d8 req-f79f84fd-0ab4-4d66-8fc5-948018877158 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181161 Aug 10 11:33:20.719718 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 52/106] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:33:20.952857 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-6d5eaca3-df1a-4e02-8ef9-9cf00161d2b3 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:20.969278 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-6d5eaca3-df1a-4e02-8ef9-9cf00161d2b3 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:20.969278 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-6d5eaca3-df1a-4e02-8ef9-9cf00161d2b3 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:20.969804 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-6d5eaca3-df1a-4e02-8ef9-9cf00161d2b3 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1406 microversion: 2.20 time: 0.309413 Aug 10 11:33:20.982082 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 55/107] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:33:20 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1406 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:33:21.019187 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-2e0b42d3-8f09-4835-9e7f-0b08688ed1c2 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:21.020969 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-2e0b42d3-8f09-4835-9e7f-0b08688ed1c2 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] [instance: 420b7baa-d100-4d8d-973f-3b29beebba6b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:21.043116 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2e0b42d3-8f09-4835-9e7f-0b08688ed1c2 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:21.043623 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2e0b42d3-8f09-4835-9e7f-0b08688ed1c2 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:21.044546 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2e0b42d3-8f09-4835-9e7f-0b08688ed1c2 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:21.045754 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2e0b42d3-8f09-4835-9e7f-0b08688ed1c2 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:21.046964 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2e0b42d3-8f09-4835-9e7f-0b08688ed1c2 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:21.047582 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2e0b42d3-8f09-4835-9e7f-0b08688ed1c2 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:21.371516 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-2e0b42d3-8f09-4835-9e7f-0b08688ed1c2 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12ec9d7cfec45ebbf390765794cbad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d79610ecd1460182af0946d8beba5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:21.381034 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-2e0b42d3-8f09-4835-9e7f-0b08688ed1c2 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] 10.222.0.62 "GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b" status: 200 len: 1315 microversion: 2.1 time: 0.373117 Aug 10 11:33:21.381769 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 53/108] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:21 2022] GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b => generated 1315 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:21.385865 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-fdc2f61f-dacc-4e11-be9e-52b2d40d5ccb tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:21.386479 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-fdc2f61f-dacc-4e11-be9e-52b2d40d5ccb tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:21.392784 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fdc2f61f-dacc-4e11-be9e-52b2d40d5ccb tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:21.393476 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fdc2f61f-dacc-4e11-be9e-52b2d40d5ccb tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:21.394080 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fdc2f61f-dacc-4e11-be9e-52b2d40d5ccb tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:21.394797 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fdc2f61f-dacc-4e11-be9e-52b2d40d5ccb tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:21.395254 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fdc2f61f-dacc-4e11-be9e-52b2d40d5ccb tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:21.395684 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fdc2f61f-dacc-4e11-be9e-52b2d40d5ccb tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:21.567851 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-fdc2f61f-dacc-4e11-be9e-52b2d40d5ccb tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:21.580670 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-fdc2f61f-dacc-4e11-be9e-52b2d40d5ccb tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1321 microversion: 2.1 time: 0.194441 Aug 10 11:33:21.581362 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 56/109] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:21 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1321 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:33:21.681137 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-4d37ecbc-fea0-40a7-aea4-55d20094c3b2 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:21.686938 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-4d37ecbc-fea0-40a7-aea4-55d20094c3b2 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:21.688587 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4d37ecbc-fea0-40a7-aea4-55d20094c3b2 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:21.689079 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4d37ecbc-fea0-40a7-aea4-55d20094c3b2 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:21.689513 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4d37ecbc-fea0-40a7-aea4-55d20094c3b2 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:21.690202 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4d37ecbc-fea0-40a7-aea4-55d20094c3b2 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:21.690648 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4d37ecbc-fea0-40a7-aea4-55d20094c3b2 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:21.691065 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4d37ecbc-fea0-40a7-aea4-55d20094c3b2 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:21.998065 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-7f3c3541-3dfb-46a8-abc9-fe414374c145 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:22.000090 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-7f3c3541-3dfb-46a8-abc9-fe414374c145 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:22.002645 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-4d37ecbc-fea0-40a7-aea4-55d20094c3b2 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:22.006993 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7f3c3541-3dfb-46a8-abc9-fe414374c145 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:22.007776 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7f3c3541-3dfb-46a8-abc9-fe414374c145 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:22.008428 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7f3c3541-3dfb-46a8-abc9-fe414374c145 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:22.012361 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7f3c3541-3dfb-46a8-abc9-fe414374c145 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:22.012361 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7f3c3541-3dfb-46a8-abc9-fe414374c145 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:22.012361 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7f3c3541-3dfb-46a8-abc9-fe414374c145 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:22.012757 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-4d37ecbc-fea0-40a7-aea4-55d20094c3b2 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1361 microversion: 2.1 time: 0.334098 Aug 10 11:33:22.012757 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 54/110] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:21 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1361 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:22.155579 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-7f3c3541-3dfb-46a8-abc9-fe414374c145 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:22.175218 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-7f3c3541-3dfb-46a8-abc9-fe414374c145 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:22.175218 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-7f3c3541-3dfb-46a8-abc9-fe414374c145 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:22.175218 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-7f3c3541-3dfb-46a8-abc9-fe414374c145 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1406 microversion: 2.20 time: 0.181930 Aug 10 11:33:22.175655 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 57/111] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:33:21 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:33:22.402628 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-e1965c6d-1a18-488b-97b7-05d90bf535ae tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:22.403333 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-e1965c6d-1a18-488b-97b7-05d90bf535ae tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] [instance: 420b7baa-d100-4d8d-973f-3b29beebba6b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:22.409467 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e1965c6d-1a18-488b-97b7-05d90bf535ae tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:22.410130 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e1965c6d-1a18-488b-97b7-05d90bf535ae tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:22.410574 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e1965c6d-1a18-488b-97b7-05d90bf535ae tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:22.411277 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e1965c6d-1a18-488b-97b7-05d90bf535ae tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:22.411904 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e1965c6d-1a18-488b-97b7-05d90bf535ae tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:22.412511 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e1965c6d-1a18-488b-97b7-05d90bf535ae tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:22.559571 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-e1965c6d-1a18-488b-97b7-05d90bf535ae tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12ec9d7cfec45ebbf390765794cbad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d79610ecd1460182af0946d8beba5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:22.568335 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-e1965c6d-1a18-488b-97b7-05d90bf535ae tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] 10.222.0.62 "GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b" status: 200 len: 1315 microversion: 2.1 time: 0.169513 Aug 10 11:33:22.570455 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 55/112] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:22 2022] GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:22.617854 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-5e32a649-1675-43ce-bcf0-9d7430cbac03 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:22.618636 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-5e32a649-1675-43ce-bcf0-9d7430cbac03 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:22.626175 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5e32a649-1675-43ce-bcf0-9d7430cbac03 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:22.626905 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5e32a649-1675-43ce-bcf0-9d7430cbac03 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:22.627519 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5e32a649-1675-43ce-bcf0-9d7430cbac03 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:22.628817 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5e32a649-1675-43ce-bcf0-9d7430cbac03 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:22.629955 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5e32a649-1675-43ce-bcf0-9d7430cbac03 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:22.630847 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5e32a649-1675-43ce-bcf0-9d7430cbac03 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:22.729508 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-40e62853-6393-4c7c-816a-d8d4bbf6d330 req-978cc88f-5aa5-4bcf-9488-d420441f0d26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e6ed242-956f-4b14-8520-18920447bf05", "name": "network-vif-plugged", "status": "completed", "tag": "f3f3926f-a2b3-40b5-a25f-a37b15cc0401"}, {"server_uuid": "420b7baa-d100-4d8d-973f-3b29beebba6b", "name": "network-vif-plugged", "status": "completed", "tag": "b777f638-0433-408a-abe4-fd50173e4085"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:33:22.740617 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-40e62853-6393-4c7c-816a-d8d4bbf6d330 req-978cc88f-5aa5-4bcf-9488-d420441f0d26 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:22.741341 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-40e62853-6393-4c7c-816a-d8d4bbf6d330 req-978cc88f-5aa5-4bcf-9488-d420441f0d26 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:22.744510 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-40e62853-6393-4c7c-816a-d8d4bbf6d330 req-978cc88f-5aa5-4bcf-9488-d420441f0d26 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:22.745799 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=100 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:33:22.761958 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-40e62853-6393-4c7c-816a-d8d4bbf6d330 req-978cc88f-5aa5-4bcf-9488-d420441f0d26 service nova] Creating event network-vif-plugged:f3f3926f-a2b3-40b5-a25f-a37b15cc0401 for instance 9e6ed242-956f-4b14-8520-18920447bf05 on hv-cinder-85272 Aug 10 11:33:22.762470 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-40e62853-6393-4c7c-816a-d8d4bbf6d330 req-978cc88f-5aa5-4bcf-9488-d420441f0d26 service nova] Creating event network-vif-plugged:b777f638-0433-408a-abe4-fd50173e4085 for instance 420b7baa-d100-4d8d-973f-3b29beebba6b on hv-cinder-85272 Aug 10 11:33:22.770324 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-40e62853-6393-4c7c-816a-d8d4bbf6d330 req-978cc88f-5aa5-4bcf-9488-d420441f0d26 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045656 Aug 10 11:33:22.770945 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 56/113] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:33:22.783919 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-5e32a649-1675-43ce-bcf0-9d7430cbac03 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:22.794904 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-5e32a649-1675-43ce-bcf0-9d7430cbac03 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1321 microversion: 2.1 time: 0.194464 Aug 10 11:33:22.800414 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 58/114] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:22 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1321 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:23.034036 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-e75473d9-1ef7-4554-bc10-bc0e32f0831d tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:23.034856 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-e75473d9-1ef7-4554-bc10-bc0e32f0831d tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:23.042378 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e75473d9-1ef7-4554-bc10-bc0e32f0831d tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:23.042941 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e75473d9-1ef7-4554-bc10-bc0e32f0831d tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:23.043520 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e75473d9-1ef7-4554-bc10-bc0e32f0831d tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:23.044248 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e75473d9-1ef7-4554-bc10-bc0e32f0831d tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:23.044814 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e75473d9-1ef7-4554-bc10-bc0e32f0831d tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:23.045934 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e75473d9-1ef7-4554-bc10-bc0e32f0831d tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:23.203335 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-b73507fd-4c03-4a33-8f1f-b070e5a2c469 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:23.204522 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-b73507fd-4c03-4a33-8f1f-b070e5a2c469 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:23.220831 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b73507fd-4c03-4a33-8f1f-b070e5a2c469 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:23.223266 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b73507fd-4c03-4a33-8f1f-b070e5a2c469 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:23.225150 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b73507fd-4c03-4a33-8f1f-b070e5a2c469 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:23.227343 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b73507fd-4c03-4a33-8f1f-b070e5a2c469 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:23.228571 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b73507fd-4c03-4a33-8f1f-b070e5a2c469 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:23.229574 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b73507fd-4c03-4a33-8f1f-b070e5a2c469 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:23.276112 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-e75473d9-1ef7-4554-bc10-bc0e32f0831d tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:23.286177 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-e75473d9-1ef7-4554-bc10-bc0e32f0831d tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1361 microversion: 2.1 time: 0.256449 Aug 10 11:33:23.292401 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 57/115] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:23 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1361 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:23.456000 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-b73507fd-4c03-4a33-8f1f-b070e5a2c469 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:23.466606 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-b73507fd-4c03-4a33-8f1f-b070e5a2c469 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:23.469626 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-b73507fd-4c03-4a33-8f1f-b070e5a2c469 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:23.471226 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-b73507fd-4c03-4a33-8f1f-b070e5a2c469 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1406 microversion: 2.20 time: 0.275000 Aug 10 11:33:23.472022 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 59/116] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:33:23 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1406 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:33:23.590611 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-a52d1f57-d75d-4277-9fa3-7a2e50668119 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:23.591344 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-a52d1f57-d75d-4277-9fa3-7a2e50668119 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] [instance: 420b7baa-d100-4d8d-973f-3b29beebba6b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:23.598119 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a52d1f57-d75d-4277-9fa3-7a2e50668119 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:23.598676 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a52d1f57-d75d-4277-9fa3-7a2e50668119 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:23.599116 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a52d1f57-d75d-4277-9fa3-7a2e50668119 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:23.599809 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a52d1f57-d75d-4277-9fa3-7a2e50668119 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:23.600285 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a52d1f57-d75d-4277-9fa3-7a2e50668119 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:23.600712 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a52d1f57-d75d-4277-9fa3-7a2e50668119 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:23.803601 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-a52d1f57-d75d-4277-9fa3-7a2e50668119 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12ec9d7cfec45ebbf390765794cbad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d79610ecd1460182af0946d8beba5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:23.811714 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-a52d1f57-d75d-4277-9fa3-7a2e50668119 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] 10.222.0.62 "GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b" status: 200 len: 1315 microversion: 2.1 time: 0.224830 Aug 10 11:33:23.812322 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 58/117] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:23 2022] GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:23.814870 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-985d4612-1e96-4452-98fa-78335192c696 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:23.815484 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-985d4612-1e96-4452-98fa-78335192c696 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:23.839759 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-985d4612-1e96-4452-98fa-78335192c696 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:23.839759 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-985d4612-1e96-4452-98fa-78335192c696 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:23.839759 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-985d4612-1e96-4452-98fa-78335192c696 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:23.839759 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-985d4612-1e96-4452-98fa-78335192c696 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:23.840099 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-985d4612-1e96-4452-98fa-78335192c696 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:23.840099 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-985d4612-1e96-4452-98fa-78335192c696 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:24.018104 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-985d4612-1e96-4452-98fa-78335192c696 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:24.030995 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-985d4612-1e96-4452-98fa-78335192c696 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1321 microversion: 2.1 time: 0.218442 Aug 10 11:33:24.048768 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 60/118] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:23 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1321 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:33:24.312993 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-932ac32c-b031-4ced-8a7d-01a5771406a2 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:24.313528 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-932ac32c-b031-4ced-8a7d-01a5771406a2 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:24.319536 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-932ac32c-b031-4ced-8a7d-01a5771406a2 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:24.320031 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-932ac32c-b031-4ced-8a7d-01a5771406a2 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:24.320465 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-932ac32c-b031-4ced-8a7d-01a5771406a2 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:24.321142 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-932ac32c-b031-4ced-8a7d-01a5771406a2 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:24.321590 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-932ac32c-b031-4ced-8a7d-01a5771406a2 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:24.322007 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-932ac32c-b031-4ced-8a7d-01a5771406a2 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:24.472871 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-932ac32c-b031-4ced-8a7d-01a5771406a2 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:24.480959 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-932ac32c-b031-4ced-8a7d-01a5771406a2 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1361 microversion: 2.1 time: 0.172963 Aug 10 11:33:24.501277 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-ed9b6bf7-b99f-47ff-85dd-6836df6ec818 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:24.508029 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-ed9b6bf7-b99f-47ff-85dd-6836df6ec818 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:24.508271 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 59/119] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:24 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1361 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:24.508352 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ed9b6bf7-b99f-47ff-85dd-6836df6ec818 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:24.508570 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ed9b6bf7-b99f-47ff-85dd-6836df6ec818 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:24.508989 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ed9b6bf7-b99f-47ff-85dd-6836df6ec818 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:24.509657 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ed9b6bf7-b99f-47ff-85dd-6836df6ec818 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:24.510112 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ed9b6bf7-b99f-47ff-85dd-6836df6ec818 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:24.511007 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ed9b6bf7-b99f-47ff-85dd-6836df6ec818 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:24.661581 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-ed9b6bf7-b99f-47ff-85dd-6836df6ec818 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:24.674373 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-ed9b6bf7-b99f-47ff-85dd-6836df6ec818 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:24.675493 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-ed9b6bf7-b99f-47ff-85dd-6836df6ec818 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:24.676188 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-ed9b6bf7-b99f-47ff-85dd-6836df6ec818 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1406 microversion: 2.20 time: 0.179309 Aug 10 11:33:24.676908 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 61/120] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:33:24 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:33:24.784753 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-a9630fa1-9b6d-4fdf-bac6-a4cbb1354d79 req-7fbb7906-4c3c-46ea-8308-c14875cd6aac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61282604-5de4-413b-be4c-80aadca981b3", "name": "network-vif-plugged", "status": "completed", "tag": "6a87af65-add0-4b0b-b0e4-e0ac69cae1fd"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:33:24.793887 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-a9630fa1-9b6d-4fdf-bac6-a4cbb1354d79 req-7fbb7906-4c3c-46ea-8308-c14875cd6aac service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:24.794380 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-a9630fa1-9b6d-4fdf-bac6-a4cbb1354d79 req-7fbb7906-4c3c-46ea-8308-c14875cd6aac service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:24.794859 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-a9630fa1-9b6d-4fdf-bac6-a4cbb1354d79 req-7fbb7906-4c3c-46ea-8308-c14875cd6aac service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:24.817612 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-a9630fa1-9b6d-4fdf-bac6-a4cbb1354d79 req-7fbb7906-4c3c-46ea-8308-c14875cd6aac service nova] Creating event network-vif-plugged:6a87af65-add0-4b0b-b0e4-e0ac69cae1fd for instance 61282604-5de4-413b-be4c-80aadca981b3 on hv-cinder-85272 Aug 10 11:33:24.825097 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-a9630fa1-9b6d-4fdf-bac6-a4cbb1354d79 req-7fbb7906-4c3c-46ea-8308-c14875cd6aac service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043411 Aug 10 11:33:24.825873 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 60/121] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:33:24.833121 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-e825c760-3c99-4d63-aea6-1c332285fd52 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:24.833916 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-e825c760-3c99-4d63-aea6-1c332285fd52 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] [instance: 420b7baa-d100-4d8d-973f-3b29beebba6b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:24.841437 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e825c760-3c99-4d63-aea6-1c332285fd52 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:24.846864 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e825c760-3c99-4d63-aea6-1c332285fd52 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:24.846864 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e825c760-3c99-4d63-aea6-1c332285fd52 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:24.846864 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e825c760-3c99-4d63-aea6-1c332285fd52 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:24.846864 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e825c760-3c99-4d63-aea6-1c332285fd52 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:24.847290 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e825c760-3c99-4d63-aea6-1c332285fd52 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:25.033819 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-e825c760-3c99-4d63-aea6-1c332285fd52 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12ec9d7cfec45ebbf390765794cbad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d79610ecd1460182af0946d8beba5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:25.042566 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-e825c760-3c99-4d63-aea6-1c332285fd52 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] 10.222.0.62 "GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b" status: 200 len: 1315 microversion: 2.1 time: 0.213358 Aug 10 11:33:25.043423 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 62/122] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:24 2022] GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:33:25.056212 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-7f9b38a4-3b62-413e-86d2-bae1b12563da tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:25.057783 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-7f9b38a4-3b62-413e-86d2-bae1b12563da tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:25.073200 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7f9b38a4-3b62-413e-86d2-bae1b12563da tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:25.073200 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7f9b38a4-3b62-413e-86d2-bae1b12563da tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:25.073200 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7f9b38a4-3b62-413e-86d2-bae1b12563da tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:25.073200 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7f9b38a4-3b62-413e-86d2-bae1b12563da tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:25.074180 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7f9b38a4-3b62-413e-86d2-bae1b12563da tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:25.074180 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7f9b38a4-3b62-413e-86d2-bae1b12563da tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:25.358403 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-7f9b38a4-3b62-413e-86d2-bae1b12563da tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:25.369022 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-7f9b38a4-3b62-413e-86d2-bae1b12563da tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1321 microversion: 2.1 time: 0.317710 Aug 10 11:33:25.383520 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 61/123] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:25 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1321 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:25.506262 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-1f01f10f-4db1-4276-bfdc-8840e7775f14 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:25.507781 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-1f01f10f-4db1-4276-bfdc-8840e7775f14 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:25.517470 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1f01f10f-4db1-4276-bfdc-8840e7775f14 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:25.518243 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1f01f10f-4db1-4276-bfdc-8840e7775f14 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:25.519460 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1f01f10f-4db1-4276-bfdc-8840e7775f14 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:25.521094 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1f01f10f-4db1-4276-bfdc-8840e7775f14 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:25.522427 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1f01f10f-4db1-4276-bfdc-8840e7775f14 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:25.524058 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1f01f10f-4db1-4276-bfdc-8840e7775f14 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:25.699613 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-323e58a2-d1e6-4a7f-a986-480916f1b130 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:25.700494 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-323e58a2-d1e6-4a7f-a986-480916f1b130 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:25.707397 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-323e58a2-d1e6-4a7f-a986-480916f1b130 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:25.707876 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-323e58a2-d1e6-4a7f-a986-480916f1b130 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:25.709512 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-323e58a2-d1e6-4a7f-a986-480916f1b130 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:25.710883 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-323e58a2-d1e6-4a7f-a986-480916f1b130 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:25.713097 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-323e58a2-d1e6-4a7f-a986-480916f1b130 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:25.713724 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-323e58a2-d1e6-4a7f-a986-480916f1b130 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:25.731439 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-1f01f10f-4db1-4276-bfdc-8840e7775f14 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:25.746833 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-1f01f10f-4db1-4276-bfdc-8840e7775f14 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1361 microversion: 2.1 time: 0.243846 Aug 10 11:33:25.747692 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 63/124] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:25 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1361 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:25.892073 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-323e58a2-d1e6-4a7f-a986-480916f1b130 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:25.901191 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-323e58a2-d1e6-4a7f-a986-480916f1b130 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:25.902961 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-323e58a2-d1e6-4a7f-a986-480916f1b130 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:25.904142 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-323e58a2-d1e6-4a7f-a986-480916f1b130 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1406 microversion: 2.20 time: 0.209149 Aug 10 11:33:25.905134 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 62/125] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:33:25 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1406 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:33:26.068725 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-e7ddf47a-c7b0-4a4c-9e44-21eaffc5890c tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:26.075002 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-e7ddf47a-c7b0-4a4c-9e44-21eaffc5890c tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] [instance: 420b7baa-d100-4d8d-973f-3b29beebba6b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:26.076381 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e7ddf47a-c7b0-4a4c-9e44-21eaffc5890c tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:26.076981 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e7ddf47a-c7b0-4a4c-9e44-21eaffc5890c tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:26.077420 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e7ddf47a-c7b0-4a4c-9e44-21eaffc5890c tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:26.078194 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e7ddf47a-c7b0-4a4c-9e44-21eaffc5890c tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:26.079254 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e7ddf47a-c7b0-4a4c-9e44-21eaffc5890c tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:26.079944 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e7ddf47a-c7b0-4a4c-9e44-21eaffc5890c tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:26.315706 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-e7ddf47a-c7b0-4a4c-9e44-21eaffc5890c tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12ec9d7cfec45ebbf390765794cbad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d79610ecd1460182af0946d8beba5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:26.323420 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-e7ddf47a-c7b0-4a4c-9e44-21eaffc5890c tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] 10.222.0.62 "GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b" status: 200 len: 1502 microversion: 2.1 time: 0.260066 Aug 10 11:33:26.324100 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 64/126] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:26 2022] GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b => generated 1502 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:26.393502 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-a95e6ac6-035b-4701-9eae-51c50827264f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:26.394054 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-a95e6ac6-035b-4701-9eae-51c50827264f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:26.400389 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a95e6ac6-035b-4701-9eae-51c50827264f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:26.400877 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a95e6ac6-035b-4701-9eae-51c50827264f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:26.401353 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a95e6ac6-035b-4701-9eae-51c50827264f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:26.402627 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a95e6ac6-035b-4701-9eae-51c50827264f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:26.403086 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a95e6ac6-035b-4701-9eae-51c50827264f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:26.403511 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a95e6ac6-035b-4701-9eae-51c50827264f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:26.546202 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-a95e6ac6-035b-4701-9eae-51c50827264f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:26.554180 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-a95e6ac6-035b-4701-9eae-51c50827264f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1321 microversion: 2.1 time: 0.167366 Aug 10 11:33:26.555050 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 63/127] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:26 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:26.769287 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-a7596b3b-3612-4fcc-bf9d-9e2b88b7a281 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:26.769981 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-a7596b3b-3612-4fcc-bf9d-9e2b88b7a281 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:26.777168 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a7596b3b-3612-4fcc-bf9d-9e2b88b7a281 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:26.787503 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a7596b3b-3612-4fcc-bf9d-9e2b88b7a281 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:26.787977 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a7596b3b-3612-4fcc-bf9d-9e2b88b7a281 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:26.791100 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a7596b3b-3612-4fcc-bf9d-9e2b88b7a281 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:26.791574 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a7596b3b-3612-4fcc-bf9d-9e2b88b7a281 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:26.792068 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a7596b3b-3612-4fcc-bf9d-9e2b88b7a281 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:26.865567 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-1ae60395-bfcc-489c-9c6b-b13960229b8d req-fa66853d-a8b7-43c3-9061-e0f31dd55a3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23e6c8bd-1889-4c18-9580-0022eb962549", "name": "network-vif-plugged", "status": "completed", "tag": "8069a065-c0f3-4da4-a7ea-aadcc5bfe815"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:33:26.876035 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-1ae60395-bfcc-489c-9c6b-b13960229b8d req-fa66853d-a8b7-43c3-9061-e0f31dd55a3c service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:26.876810 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-1ae60395-bfcc-489c-9c6b-b13960229b8d req-fa66853d-a8b7-43c3-9061-e0f31dd55a3c service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:26.877433 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-1ae60395-bfcc-489c-9c6b-b13960229b8d req-fa66853d-a8b7-43c3-9061-e0f31dd55a3c service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:26.926568 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-1ae60395-bfcc-489c-9c6b-b13960229b8d req-fa66853d-a8b7-43c3-9061-e0f31dd55a3c service nova] Creating event network-vif-plugged:8069a065-c0f3-4da4-a7ea-aadcc5bfe815 for instance 23e6c8bd-1889-4c18-9580-0022eb962549 on hv-cinder-85272 Aug 10 11:33:26.933395 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-1ae60395-bfcc-489c-9c6b-b13960229b8d req-fa66853d-a8b7-43c3-9061-e0f31dd55a3c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071134 Aug 10 11:33:26.934135 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 64/128] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:33:26.942204 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-f98a8992-e2f9-4074-9fe9-8ad1feaeb3cc tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:26.943557 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-f98a8992-e2f9-4074-9fe9-8ad1feaeb3cc tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:26.951587 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f98a8992-e2f9-4074-9fe9-8ad1feaeb3cc tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:26.952243 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f98a8992-e2f9-4074-9fe9-8ad1feaeb3cc tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:26.953526 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f98a8992-e2f9-4074-9fe9-8ad1feaeb3cc tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:26.954380 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f98a8992-e2f9-4074-9fe9-8ad1feaeb3cc tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:26.955415 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f98a8992-e2f9-4074-9fe9-8ad1feaeb3cc tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:26.963893 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f98a8992-e2f9-4074-9fe9-8ad1feaeb3cc tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:26.999535 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-a7596b3b-3612-4fcc-bf9d-9e2b88b7a281 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:27.009064 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-a7596b3b-3612-4fcc-bf9d-9e2b88b7a281 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1361 microversion: 2.1 time: 0.244451 Aug 10 11:33:27.010094 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 65/129] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:26 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1361 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:27.143952 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-f98a8992-e2f9-4074-9fe9-8ad1feaeb3cc tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:27.154569 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-f98a8992-e2f9-4074-9fe9-8ad1feaeb3cc tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:27.156290 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-f98a8992-e2f9-4074-9fe9-8ad1feaeb3cc tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:27.157644 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-f98a8992-e2f9-4074-9fe9-8ad1feaeb3cc tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1599 microversion: 2.20 time: 0.221891 Aug 10 11:33:27.158886 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 65/130] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:33:26 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1599 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:33:27.203729 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-fd99cad5-1143-44c1-bdf7-8028c4f994a2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:27.204607 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-fd99cad5-1143-44c1-bdf7-8028c4f994a2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:27.211354 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fd99cad5-1143-44c1-bdf7-8028c4f994a2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:27.211894 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fd99cad5-1143-44c1-bdf7-8028c4f994a2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:27.212591 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fd99cad5-1143-44c1-bdf7-8028c4f994a2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:27.213296 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fd99cad5-1143-44c1-bdf7-8028c4f994a2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:27.213752 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fd99cad5-1143-44c1-bdf7-8028c4f994a2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:27.214175 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fd99cad5-1143-44c1-bdf7-8028c4f994a2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:27.338515 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-fd99cad5-1143-44c1-bdf7-8028c4f994a2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.141071 Aug 10 11:33:27.339111 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 66/131] 10.222.0.62 () {60 vars in 1316 bytes} [Wed Aug 10 11:33:27 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05/os-interface => generated 285 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:33:27.577372 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-0c15a59b-a05f-439e-800d-b7d5e9320dd7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:27.578855 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-0c15a59b-a05f-439e-800d-b7d5e9320dd7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:27.587012 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0c15a59b-a05f-439e-800d-b7d5e9320dd7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:27.592147 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0c15a59b-a05f-439e-800d-b7d5e9320dd7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:27.592147 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0c15a59b-a05f-439e-800d-b7d5e9320dd7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:27.592147 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0c15a59b-a05f-439e-800d-b7d5e9320dd7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:27.592147 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0c15a59b-a05f-439e-800d-b7d5e9320dd7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:27.592586 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0c15a59b-a05f-439e-800d-b7d5e9320dd7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:27.785028 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-0c15a59b-a05f-439e-800d-b7d5e9320dd7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:27.794643 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-0c15a59b-a05f-439e-800d-b7d5e9320dd7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1321 microversion: 2.1 time: 0.223646 Aug 10 11:33:27.795448 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 66/132] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:27 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1321 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:28.032583 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-37f0220e-455e-41c4-8ad9-2946e7d3b0ae tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:28.033778 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-37f0220e-455e-41c4-8ad9-2946e7d3b0ae tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:28.040549 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-37f0220e-455e-41c4-8ad9-2946e7d3b0ae tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:28.041477 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-37f0220e-455e-41c4-8ad9-2946e7d3b0ae tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:28.042118 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-37f0220e-455e-41c4-8ad9-2946e7d3b0ae tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:28.043187 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-37f0220e-455e-41c4-8ad9-2946e7d3b0ae tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:28.043904 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-37f0220e-455e-41c4-8ad9-2946e7d3b0ae tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:28.044599 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-37f0220e-455e-41c4-8ad9-2946e7d3b0ae tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:28.448204 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-37f0220e-455e-41c4-8ad9-2946e7d3b0ae tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:28.453929 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-37f0220e-455e-41c4-8ad9-2946e7d3b0ae tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1548 microversion: 2.1 time: 0.427047 Aug 10 11:33:28.454605 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 67/133] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:28 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1548 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:28.457382 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-dd247725-d35b-4931-8e19-732dc4df710d tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7fbc264e-4d1f-4c3d-ac1b-6674687a4b0f"}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:33:28.460804 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-dd247725-d35b-4931-8e19-732dc4df710d tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] [instance: 420b7baa-d100-4d8d-973f-3b29beebba6b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:28.468329 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-dd247725-d35b-4931-8e19-732dc4df710d tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:28.469117 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-dd247725-d35b-4931-8e19-732dc4df710d tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:28.469697 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-dd247725-d35b-4931-8e19-732dc4df710d tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:28.470643 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-dd247725-d35b-4931-8e19-732dc4df710d tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:28.471155 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-dd247725-d35b-4931-8e19-732dc4df710d tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:28.471784 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-dd247725-d35b-4931-8e19-732dc4df710d tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:28.493447 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-e2a09fd1-9fae-4c59-9d19-f58297374f52 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:28.494033 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-e2a09fd1-9fae-4c59-9d19-f58297374f52 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:28.501330 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e2a09fd1-9fae-4c59-9d19-f58297374f52 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:28.501996 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e2a09fd1-9fae-4c59-9d19-f58297374f52 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:28.502530 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e2a09fd1-9fae-4c59-9d19-f58297374f52 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:28.503470 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e2a09fd1-9fae-4c59-9d19-f58297374f52 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:28.504062 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e2a09fd1-9fae-4c59-9d19-f58297374f52 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:28.505154 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e2a09fd1-9fae-4c59-9d19-f58297374f52 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:28.593677 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-e2a09fd1-9fae-4c59-9d19-f58297374f52 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.104755 Aug 10 11:33:28.594593 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 68/134] 10.222.0.62 () {58 vars in 1275 bytes} [Wed Aug 10 11:33:28 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:33:28.816543 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-8974b202-8404-4a76-97be-b5157cc627b1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:28.817172 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-8974b202-8404-4a76-97be-b5157cc627b1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:28.829285 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8974b202-8404-4a76-97be-b5157cc627b1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:28.829285 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8974b202-8404-4a76-97be-b5157cc627b1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:28.832044 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8974b202-8404-4a76-97be-b5157cc627b1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:28.833012 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8974b202-8404-4a76-97be-b5157cc627b1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:28.833629 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8974b202-8404-4a76-97be-b5157cc627b1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:28.834092 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8974b202-8404-4a76-97be-b5157cc627b1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:29.036369 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-8974b202-8404-4a76-97be-b5157cc627b1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:29.045524 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-8974b202-8404-4a76-97be-b5157cc627b1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1321 microversion: 2.1 time: 0.234148 Aug 10 11:33:29.060232 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 69/135] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:28 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1321 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:33:29.427910 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-76fb89b9-af78-4cee-805d-1133b5c89b4b req-658c623e-9ac7-4edd-9174-627f905093b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e6ed242-956f-4b14-8520-18920447bf05", "tag": "f3f3926f-a2b3-40b5-a25f-a37b15cc0401"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:33:29.444389 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-76fb89b9-af78-4cee-805d-1133b5c89b4b req-658c623e-9ac7-4edd-9174-627f905093b5 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:29.460670 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-76fb89b9-af78-4cee-805d-1133b5c89b4b req-658c623e-9ac7-4edd-9174-627f905093b5 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:29.461288 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-76fb89b9-af78-4cee-805d-1133b5c89b4b req-658c623e-9ac7-4edd-9174-627f905093b5 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:29.473649 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-76fb89b9-af78-4cee-805d-1133b5c89b4b req-658c623e-9ac7-4edd-9174-627f905093b5 service nova] Creating event network-changed:f3f3926f-a2b3-40b5-a25f-a37b15cc0401 for instance 9e6ed242-956f-4b14-8520-18920447bf05 on hv-cinder-85272 Aug 10 11:33:29.479336 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-76fb89b9-af78-4cee-805d-1133b5c89b4b req-658c623e-9ac7-4edd-9174-627f905093b5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056229 Aug 10 11:33:29.480009 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 70/136] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:33:29.701993 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-dd247725-d35b-4931-8e19-732dc4df710d tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] 10.222.0.62 "POST /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.243840 Aug 10 11:33:29.703405 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 67/137] 10.222.0.62 () {60 vars in 1323 bytes} [Wed Aug 10 11:33:28 2022] POST /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b/os-volume_attachments => generated 194 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:33:30.067942 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-868f3f41-ed10-4743-8f35-fde3127dafb5 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:30.068590 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-868f3f41-ed10-4743-8f35-fde3127dafb5 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:30.074821 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-868f3f41-ed10-4743-8f35-fde3127dafb5 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:30.075312 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-868f3f41-ed10-4743-8f35-fde3127dafb5 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:30.075777 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-868f3f41-ed10-4743-8f35-fde3127dafb5 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:30.077378 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-868f3f41-ed10-4743-8f35-fde3127dafb5 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:30.077842 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-868f3f41-ed10-4743-8f35-fde3127dafb5 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:30.082895 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-868f3f41-ed10-4743-8f35-fde3127dafb5 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:30.287394 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-868f3f41-ed10-4743-8f35-fde3127dafb5 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:30.296672 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-868f3f41-ed10-4743-8f35-fde3127dafb5 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1515 microversion: 2.1 time: 0.233059 Aug 10 11:33:30.297254 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 71/138] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:30 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1515 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:30.321184 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-93acdb10-ae83-4212-98c2-4bc0607375de tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:33:30.327919 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-93acdb10-ae83-4212-98c2-4bc0607375de tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:30.336861 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-93acdb10-ae83-4212-98c2-4bc0607375de tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:30.337706 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-93acdb10-ae83-4212-98c2-4bc0607375de tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:30.338280 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-93acdb10-ae83-4212-98c2-4bc0607375de tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:30.339458 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-93acdb10-ae83-4212-98c2-4bc0607375de tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:30.340141 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-93acdb10-ae83-4212-98c2-4bc0607375de tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:30.340760 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-93acdb10-ae83-4212-98c2-4bc0607375de tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:30.386337 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.objects.instance [None req-93acdb10-ae83-4212-98c2-4bc0607375de tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lazy-loading 'flavor' on Instance uuid 23e6c8bd-1889-4c18-9580-0022eb962549 {{(pid=124682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:33:30.543384 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-11666a24-bb2b-492a-b9f4-12aab98dbcf5 req-69f0c257-2219-4481-b515-469901b406b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61282604-5de4-413b-be4c-80aadca981b3", "tag": "6a87af65-add0-4b0b-b0e4-e0ac69cae1fd"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:33:30.564628 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-11666a24-bb2b-492a-b9f4-12aab98dbcf5 req-69f0c257-2219-4481-b515-469901b406b4 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:30.567072 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-11666a24-bb2b-492a-b9f4-12aab98dbcf5 req-69f0c257-2219-4481-b515-469901b406b4 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:30.569377 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-11666a24-bb2b-492a-b9f4-12aab98dbcf5 req-69f0c257-2219-4481-b515-469901b406b4 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:30.595643 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-11666a24-bb2b-492a-b9f4-12aab98dbcf5 req-69f0c257-2219-4481-b515-469901b406b4 service nova] Creating event network-changed:6a87af65-add0-4b0b-b0e4-e0ac69cae1fd for instance 61282604-5de4-413b-be4c-80aadca981b3 on hv-cinder-85272 Aug 10 11:33:30.601401 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-11666a24-bb2b-492a-b9f4-12aab98dbcf5 req-69f0c257-2219-4481-b515-469901b406b4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062903 Aug 10 11:33:30.602158 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 72/139] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:33:30.894492 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-93acdb10-ae83-4212-98c2-4bc0607375de tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "POST /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549/action" status: 200 len: 32 microversion: 2.1 time: 0.576536 Aug 10 11:33:30.914325 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f0119e3e-8f79-4157-8f04-92d6c1dc50eb tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:30.915338 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-f0119e3e-8f79-4157-8f04-92d6c1dc50eb tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:30.921942 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 68/140] 10.222.0.62 () {60 vars in 1278 bytes} [Wed Aug 10 11:33:30 2022] POST /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549/action => generated 32 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 11:33:30.928221 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f0119e3e-8f79-4157-8f04-92d6c1dc50eb tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:30.928720 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f0119e3e-8f79-4157-8f04-92d6c1dc50eb tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:30.929166 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f0119e3e-8f79-4157-8f04-92d6c1dc50eb tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:30.930501 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f0119e3e-8f79-4157-8f04-92d6c1dc50eb tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:30.930966 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f0119e3e-8f79-4157-8f04-92d6c1dc50eb tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:30.931754 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f0119e3e-8f79-4157-8f04-92d6c1dc50eb tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:30.971866 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=100 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:33:31.237177 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-f0119e3e-8f79-4157-8f04-92d6c1dc50eb tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:31.251555 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-f0119e3e-8f79-4157-8f04-92d6c1dc50eb tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1521 microversion: 2.1 time: 0.345467 Aug 10 11:33:31.252511 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 73/141] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:30 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1521 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:32.281947 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-36f8fc58-9760-4e96-8588-d2b64dfb5a8e tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:32.283806 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-36f8fc58-9760-4e96-8588-d2b64dfb5a8e tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:32.299366 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-36f8fc58-9760-4e96-8588-d2b64dfb5a8e tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:32.300046 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-36f8fc58-9760-4e96-8588-d2b64dfb5a8e tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:32.304123 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-36f8fc58-9760-4e96-8588-d2b64dfb5a8e tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:32.304123 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-36f8fc58-9760-4e96-8588-d2b64dfb5a8e tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:32.304123 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-36f8fc58-9760-4e96-8588-d2b64dfb5a8e tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:32.304123 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-36f8fc58-9760-4e96-8588-d2b64dfb5a8e tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:32.471029 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-36f8fc58-9760-4e96-8588-d2b64dfb5a8e tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:32.476802 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-36f8fc58-9760-4e96-8588-d2b64dfb5a8e tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1521 microversion: 2.1 time: 0.202376 Aug 10 11:33:32.477444 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 69/142] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:32 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:33.498162 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-6d516cef-87bb-4bb0-a3a6-e18bc4bea19a tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:33.498834 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-6d516cef-87bb-4bb0-a3a6-e18bc4bea19a tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:33.505657 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6d516cef-87bb-4bb0-a3a6-e18bc4bea19a tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:33.506184 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6d516cef-87bb-4bb0-a3a6-e18bc4bea19a tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:33.506612 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6d516cef-87bb-4bb0-a3a6-e18bc4bea19a tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:33.507317 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6d516cef-87bb-4bb0-a3a6-e18bc4bea19a tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:33.507769 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6d516cef-87bb-4bb0-a3a6-e18bc4bea19a tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:33.508202 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6d516cef-87bb-4bb0-a3a6-e18bc4bea19a tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:33.693304 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-6d516cef-87bb-4bb0-a3a6-e18bc4bea19a tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:33.701801 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-6d516cef-87bb-4bb0-a3a6-e18bc4bea19a tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1521 microversion: 2.1 time: 0.207018 Aug 10 11:33:33.702463 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 74/143] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:33 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:34.723134 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-0e579775-12dc-43a4-b7fc-71649e7633bf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:34.723748 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-0e579775-12dc-43a4-b7fc-71649e7633bf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:34.730260 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0e579775-12dc-43a4-b7fc-71649e7633bf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:34.730793 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0e579775-12dc-43a4-b7fc-71649e7633bf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:34.731244 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0e579775-12dc-43a4-b7fc-71649e7633bf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:34.731928 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0e579775-12dc-43a4-b7fc-71649e7633bf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:34.733061 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0e579775-12dc-43a4-b7fc-71649e7633bf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:34.733489 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0e579775-12dc-43a4-b7fc-71649e7633bf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:34.867767 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-0e579775-12dc-43a4-b7fc-71649e7633bf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:34.875787 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-0e579775-12dc-43a4-b7fc-71649e7633bf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1521 microversion: 2.1 time: 0.156476 Aug 10 11:33:34.876390 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 70/144] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:34 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:35.898181 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-85c7a722-1027-41ba-9a9a-9975ae5eddf1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:35.898802 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-85c7a722-1027-41ba-9a9a-9975ae5eddf1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:35.904861 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-85c7a722-1027-41ba-9a9a-9975ae5eddf1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:35.905372 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-85c7a722-1027-41ba-9a9a-9975ae5eddf1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:35.905869 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-85c7a722-1027-41ba-9a9a-9975ae5eddf1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:35.906602 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-85c7a722-1027-41ba-9a9a-9975ae5eddf1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:35.907062 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-85c7a722-1027-41ba-9a9a-9975ae5eddf1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:35.907487 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-85c7a722-1027-41ba-9a9a-9975ae5eddf1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:36.046810 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-85c7a722-1027-41ba-9a9a-9975ae5eddf1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:36.055278 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-85c7a722-1027-41ba-9a9a-9975ae5eddf1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1521 microversion: 2.1 time: 0.160993 Aug 10 11:33:36.056774 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 75/145] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:35 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:37.080256 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-b18d8038-cbd7-4b4c-8b96-60d9ebc3a4f2 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:37.080867 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-b18d8038-cbd7-4b4c-8b96-60d9ebc3a4f2 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:37.087389 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b18d8038-cbd7-4b4c-8b96-60d9ebc3a4f2 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:37.087875 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b18d8038-cbd7-4b4c-8b96-60d9ebc3a4f2 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:37.088343 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b18d8038-cbd7-4b4c-8b96-60d9ebc3a4f2 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:37.089038 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b18d8038-cbd7-4b4c-8b96-60d9ebc3a4f2 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:37.089487 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b18d8038-cbd7-4b4c-8b96-60d9ebc3a4f2 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:37.089911 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b18d8038-cbd7-4b4c-8b96-60d9ebc3a4f2 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:37.109478 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:33:37.245730 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b18d8038-cbd7-4b4c-8b96-60d9ebc3a4f2 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:37.253595 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-b18d8038-cbd7-4b4c-8b96-60d9ebc3a4f2 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1521 microversion: 2.1 time: 0.178790 Aug 10 11:33:37.254337 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 71/146] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:37 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:38.277624 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-685e8980-14e0-4f96-ab3d-65b06dd72ab9 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:38.278309 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-685e8980-14e0-4f96-ab3d-65b06dd72ab9 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:38.285315 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-685e8980-14e0-4f96-ab3d-65b06dd72ab9 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:38.285986 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-685e8980-14e0-4f96-ab3d-65b06dd72ab9 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:38.286424 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-685e8980-14e0-4f96-ab3d-65b06dd72ab9 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:38.287163 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-685e8980-14e0-4f96-ab3d-65b06dd72ab9 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:38.287594 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-685e8980-14e0-4f96-ab3d-65b06dd72ab9 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:38.288039 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-685e8980-14e0-4f96-ab3d-65b06dd72ab9 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:38.423546 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-685e8980-14e0-4f96-ab3d-65b06dd72ab9 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:38.432190 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-685e8980-14e0-4f96-ab3d-65b06dd72ab9 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1521 microversion: 2.1 time: 0.158680 Aug 10 11:33:38.432870 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 76/147] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:38 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:39.017309 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-ee3e953d-17ba-4bcf-b730-2e463973cb2a tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:39.018455 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-ee3e953d-17ba-4bcf-b730-2e463973cb2a tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] [instance: 420b7baa-d100-4d8d-973f-3b29beebba6b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:39.026550 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ee3e953d-17ba-4bcf-b730-2e463973cb2a tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:39.027293 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ee3e953d-17ba-4bcf-b730-2e463973cb2a tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:39.027736 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ee3e953d-17ba-4bcf-b730-2e463973cb2a tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:39.031294 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ee3e953d-17ba-4bcf-b730-2e463973cb2a tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:39.031294 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ee3e953d-17ba-4bcf-b730-2e463973cb2a tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:39.031294 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ee3e953d-17ba-4bcf-b730-2e463973cb2a tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:39.058078 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-ee3e953d-17ba-4bcf-b730-2e463973cb2a tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] [instance: 420b7baa-d100-4d8d-973f-3b29beebba6b] Going to try to terminate instance {{(pid=124682) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:33:39.354591 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-ee3e953d-17ba-4bcf-b730-2e463973cb2a tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] 10.222.0.62 "DELETE /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b" status: 204 len: 0 microversion: 2.1 time: 0.341211 Aug 10 11:33:39.354591 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 72/148] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 10 11:33:39 2022] DELETE /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:33:39.361833 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-0926815b-dd6d-4240-9f44-8df2ce727482 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:39.362451 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-0926815b-dd6d-4240-9f44-8df2ce727482 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] [instance: 420b7baa-d100-4d8d-973f-3b29beebba6b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:39.371720 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0926815b-dd6d-4240-9f44-8df2ce727482 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:39.372290 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0926815b-dd6d-4240-9f44-8df2ce727482 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:39.372759 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0926815b-dd6d-4240-9f44-8df2ce727482 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:39.373492 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0926815b-dd6d-4240-9f44-8df2ce727482 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:39.374200 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0926815b-dd6d-4240-9f44-8df2ce727482 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:39.374638 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0926815b-dd6d-4240-9f44-8df2ce727482 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:39.455734 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-d637f0c2-cea7-465b-b601-5848a832a7cd tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:39.457243 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-d637f0c2-cea7-465b-b601-5848a832a7cd tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:39.463647 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d637f0c2-cea7-465b-b601-5848a832a7cd tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:39.464275 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d637f0c2-cea7-465b-b601-5848a832a7cd tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:39.464709 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d637f0c2-cea7-465b-b601-5848a832a7cd tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:39.465463 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d637f0c2-cea7-465b-b601-5848a832a7cd tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:39.465914 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d637f0c2-cea7-465b-b601-5848a832a7cd tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:39.466337 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d637f0c2-cea7-465b-b601-5848a832a7cd tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:39.516660 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-0926815b-dd6d-4240-9f44-8df2ce727482 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12ec9d7cfec45ebbf390765794cbad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d79610ecd1460182af0946d8beba5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:39.527202 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-0926815b-dd6d-4240-9f44-8df2ce727482 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] 10.222.0.62 "GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b" status: 200 len: 1554 microversion: 2.1 time: 0.169387 Aug 10 11:33:39.531477 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 77/149] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:39 2022] GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b => generated 1554 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:39.615525 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-d637f0c2-cea7-465b-b601-5848a832a7cd tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:39.623253 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-d637f0c2-cea7-465b-b601-5848a832a7cd tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1521 microversion: 2.1 time: 0.172507 Aug 10 11:33:39.623643 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 73/150] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:39 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:33:40.550832 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-9147b83a-7b0e-443e-903c-96ecb336986b tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:40.551371 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-9147b83a-7b0e-443e-903c-96ecb336986b tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] [instance: 420b7baa-d100-4d8d-973f-3b29beebba6b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:40.557253 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9147b83a-7b0e-443e-903c-96ecb336986b tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:40.557716 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9147b83a-7b0e-443e-903c-96ecb336986b tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:40.558153 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9147b83a-7b0e-443e-903c-96ecb336986b tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:40.558840 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9147b83a-7b0e-443e-903c-96ecb336986b tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:40.559298 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9147b83a-7b0e-443e-903c-96ecb336986b tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:40.559730 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9147b83a-7b0e-443e-903c-96ecb336986b tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:40.644899 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-de95c109-8580-4d8a-8c50-2a39fc80121e tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:40.645520 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-de95c109-8580-4d8a-8c50-2a39fc80121e tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:40.649446 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:33:40.653599 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-de95c109-8580-4d8a-8c50-2a39fc80121e tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:40.654254 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-de95c109-8580-4d8a-8c50-2a39fc80121e tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:40.654782 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-de95c109-8580-4d8a-8c50-2a39fc80121e tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:40.655483 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-de95c109-8580-4d8a-8c50-2a39fc80121e tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:40.656312 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-de95c109-8580-4d8a-8c50-2a39fc80121e tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:40.656746 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-de95c109-8580-4d8a-8c50-2a39fc80121e tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:40.727809 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-9147b83a-7b0e-443e-903c-96ecb336986b tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12ec9d7cfec45ebbf390765794cbad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d79610ecd1460182af0946d8beba5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:40.748988 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-9147b83a-7b0e-443e-903c-96ecb336986b tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] 10.222.0.62 "GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b" status: 200 len: 1554 microversion: 2.1 time: 0.199564 Aug 10 11:33:40.763379 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 78/151] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:40 2022] GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b => generated 1554 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:40.803561 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-de95c109-8580-4d8a-8c50-2a39fc80121e tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:40.810999 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-de95c109-8580-4d8a-8c50-2a39fc80121e tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1521 microversion: 2.1 time: 0.169936 Aug 10 11:33:40.811560 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 74/152] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:40 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:41.771666 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-3e1ce157-ce05-45ad-b18e-aeee7b62224d tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:41.773098 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-3e1ce157-ce05-45ad-b18e-aeee7b62224d tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] [instance: 420b7baa-d100-4d8d-973f-3b29beebba6b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:41.779299 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3e1ce157-ce05-45ad-b18e-aeee7b62224d tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:41.779814 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3e1ce157-ce05-45ad-b18e-aeee7b62224d tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:41.780254 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3e1ce157-ce05-45ad-b18e-aeee7b62224d tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:41.781121 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3e1ce157-ce05-45ad-b18e-aeee7b62224d tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:41.781579 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3e1ce157-ce05-45ad-b18e-aeee7b62224d tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:41.783025 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3e1ce157-ce05-45ad-b18e-aeee7b62224d tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:41.831381 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-cc5dd4d4-d6d7-417a-b908-daf0c767a645 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:41.832033 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-cc5dd4d4-d6d7-417a-b908-daf0c767a645 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:41.838534 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cc5dd4d4-d6d7-417a-b908-daf0c767a645 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:41.839011 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cc5dd4d4-d6d7-417a-b908-daf0c767a645 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:41.839447 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cc5dd4d4-d6d7-417a-b908-daf0c767a645 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:41.840179 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cc5dd4d4-d6d7-417a-b908-daf0c767a645 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:41.840634 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cc5dd4d4-d6d7-417a-b908-daf0c767a645 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:41.841061 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cc5dd4d4-d6d7-417a-b908-daf0c767a645 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:41.961991 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-3e1ce157-ce05-45ad-b18e-aeee7b62224d tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12ec9d7cfec45ebbf390765794cbad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d79610ecd1460182af0946d8beba5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:41.978843 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-3e1ce157-ce05-45ad-b18e-aeee7b62224d tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] 10.222.0.62 "GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b" status: 200 len: 1554 microversion: 2.1 time: 0.203962 Aug 10 11:33:41.978843 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 79/153] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:41 2022] GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b => generated 1554 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:42.000660 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-cc5dd4d4-d6d7-417a-b908-daf0c767a645 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:42.007945 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-cc5dd4d4-d6d7-417a-b908-daf0c767a645 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1521 microversion: 2.1 time: 0.181000 Aug 10 11:33:42.010793 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 75/154] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:41 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:33:42.992376 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-8d0473bc-db58-46d5-887d-a6ee2f08c8aa tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:42.992992 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-8d0473bc-db58-46d5-887d-a6ee2f08c8aa tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] [instance: 420b7baa-d100-4d8d-973f-3b29beebba6b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:42.998857 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8d0473bc-db58-46d5-887d-a6ee2f08c8aa tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:43.000647 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8d0473bc-db58-46d5-887d-a6ee2f08c8aa tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:43.000647 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8d0473bc-db58-46d5-887d-a6ee2f08c8aa tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:43.000647 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8d0473bc-db58-46d5-887d-a6ee2f08c8aa tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:43.001020 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8d0473bc-db58-46d5-887d-a6ee2f08c8aa tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:43.001396 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8d0473bc-db58-46d5-887d-a6ee2f08c8aa tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:43.041938 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-cadabdd7-76aa-4a70-b721-22737a286f0c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:43.042600 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-cadabdd7-76aa-4a70-b721-22737a286f0c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:43.049706 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cadabdd7-76aa-4a70-b721-22737a286f0c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:43.050192 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cadabdd7-76aa-4a70-b721-22737a286f0c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:43.050624 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cadabdd7-76aa-4a70-b721-22737a286f0c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:43.051312 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cadabdd7-76aa-4a70-b721-22737a286f0c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:43.051760 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cadabdd7-76aa-4a70-b721-22737a286f0c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:43.052217 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cadabdd7-76aa-4a70-b721-22737a286f0c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:43.147532 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-8d0473bc-db58-46d5-887d-a6ee2f08c8aa tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12ec9d7cfec45ebbf390765794cbad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d79610ecd1460182af0946d8beba5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:43.157247 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-8d0473bc-db58-46d5-887d-a6ee2f08c8aa tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] 10.222.0.62 "GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b" status: 200 len: 1554 microversion: 2.1 time: 0.168653 Aug 10 11:33:43.158162 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 80/155] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:42 2022] GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b => generated 1554 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:43.203971 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-cadabdd7-76aa-4a70-b721-22737a286f0c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:43.211854 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-cadabdd7-76aa-4a70-b721-22737a286f0c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1521 microversion: 2.1 time: 0.183542 Aug 10 11:33:43.212451 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 76/156] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:43 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:44.181203 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-d72967c5-e3ea-4ecb-bbd6-90c38fe355c3 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:44.181947 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-d72967c5-e3ea-4ecb-bbd6-90c38fe355c3 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] [instance: 420b7baa-d100-4d8d-973f-3b29beebba6b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:44.188247 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=88 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:33:44.189723 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d72967c5-e3ea-4ecb-bbd6-90c38fe355c3 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:44.190205 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d72967c5-e3ea-4ecb-bbd6-90c38fe355c3 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:44.190635 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d72967c5-e3ea-4ecb-bbd6-90c38fe355c3 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:44.191443 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d72967c5-e3ea-4ecb-bbd6-90c38fe355c3 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:44.192101 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d72967c5-e3ea-4ecb-bbd6-90c38fe355c3 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:44.192528 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d72967c5-e3ea-4ecb-bbd6-90c38fe355c3 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:44.239909 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-6803d735-dbae-45e4-bacc-7243a90bb13b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:44.241396 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-6803d735-dbae-45e4-bacc-7243a90bb13b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:44.250453 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6803d735-dbae-45e4-bacc-7243a90bb13b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:44.251545 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6803d735-dbae-45e4-bacc-7243a90bb13b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:44.252128 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6803d735-dbae-45e4-bacc-7243a90bb13b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:44.253146 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6803d735-dbae-45e4-bacc-7243a90bb13b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:44.253751 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6803d735-dbae-45e4-bacc-7243a90bb13b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:44.254179 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6803d735-dbae-45e4-bacc-7243a90bb13b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:44.345433 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-d72967c5-e3ea-4ecb-bbd6-90c38fe355c3 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12ec9d7cfec45ebbf390765794cbad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d79610ecd1460182af0946d8beba5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:44.355473 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-d72967c5-e3ea-4ecb-bbd6-90c38fe355c3 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] 10.222.0.62 "GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b" status: 200 len: 1554 microversion: 2.1 time: 0.179994 Aug 10 11:33:44.356820 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 81/157] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:44 2022] GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b => generated 1554 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:44.412952 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-6803d735-dbae-45e4-bacc-7243a90bb13b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:44.421191 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-6803d735-dbae-45e4-bacc-7243a90bb13b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1521 microversion: 2.1 time: 0.185973 Aug 10 11:33:44.421805 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 77/158] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:44 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:45.377133 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-8937f699-1d3c-4f43-a762-314c6928888b tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:45.377767 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-8937f699-1d3c-4f43-a762-314c6928888b tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] [instance: 420b7baa-d100-4d8d-973f-3b29beebba6b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:45.383911 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8937f699-1d3c-4f43-a762-314c6928888b tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:45.384324 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8937f699-1d3c-4f43-a762-314c6928888b tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:45.384799 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8937f699-1d3c-4f43-a762-314c6928888b tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:45.385471 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8937f699-1d3c-4f43-a762-314c6928888b tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:45.385919 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8937f699-1d3c-4f43-a762-314c6928888b tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:45.386339 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8937f699-1d3c-4f43-a762-314c6928888b tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:45.441741 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-ef574bb3-a596-4d93-81b1-daf3508eedd9 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:45.442440 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-ef574bb3-a596-4d93-81b1-daf3508eedd9 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:45.450244 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ef574bb3-a596-4d93-81b1-daf3508eedd9 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:45.451308 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ef574bb3-a596-4d93-81b1-daf3508eedd9 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:45.451792 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ef574bb3-a596-4d93-81b1-daf3508eedd9 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:45.452665 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ef574bb3-a596-4d93-81b1-daf3508eedd9 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:45.453890 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ef574bb3-a596-4d93-81b1-daf3508eedd9 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:45.454313 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ef574bb3-a596-4d93-81b1-daf3508eedd9 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:45.550379 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-8937f699-1d3c-4f43-a762-314c6928888b tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12ec9d7cfec45ebbf390765794cbad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d79610ecd1460182af0946d8beba5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:45.566504 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-8937f699-1d3c-4f43-a762-314c6928888b tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] 10.222.0.62 "GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b" status: 200 len: 1554 microversion: 2.1 time: 0.194112 Aug 10 11:33:45.568496 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 82/159] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:45 2022] GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b => generated 1554 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:45.611759 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-ef574bb3-a596-4d93-81b1-daf3508eedd9 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:45.619238 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-ef574bb3-a596-4d93-81b1-daf3508eedd9 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1521 microversion: 2.1 time: 0.181739 Aug 10 11:33:45.619805 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 78/160] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:45 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:46.592415 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-bc600fe7-dab8-4721-a2c6-a1c943c13d82 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:46.593046 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-bc600fe7-dab8-4721-a2c6-a1c943c13d82 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] [instance: 420b7baa-d100-4d8d-973f-3b29beebba6b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:46.598977 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bc600fe7-dab8-4721-a2c6-a1c943c13d82 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:46.599459 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bc600fe7-dab8-4721-a2c6-a1c943c13d82 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:46.599891 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bc600fe7-dab8-4721-a2c6-a1c943c13d82 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:46.600677 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bc600fe7-dab8-4721-a2c6-a1c943c13d82 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:46.601131 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bc600fe7-dab8-4721-a2c6-a1c943c13d82 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:46.601579 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bc600fe7-dab8-4721-a2c6-a1c943c13d82 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:46.642473 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-82733421-d30d-4c83-ac56-465b3b6a0595 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:46.643327 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-82733421-d30d-4c83-ac56-465b3b6a0595 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:46.649844 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-82733421-d30d-4c83-ac56-465b3b6a0595 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:46.650408 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-82733421-d30d-4c83-ac56-465b3b6a0595 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:46.650916 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-82733421-d30d-4c83-ac56-465b3b6a0595 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:46.651675 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-82733421-d30d-4c83-ac56-465b3b6a0595 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:46.652248 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-82733421-d30d-4c83-ac56-465b3b6a0595 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:46.652815 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-82733421-d30d-4c83-ac56-465b3b6a0595 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:46.739899 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-bc600fe7-dab8-4721-a2c6-a1c943c13d82 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12ec9d7cfec45ebbf390765794cbad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d79610ecd1460182af0946d8beba5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:46.751152 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-bc600fe7-dab8-4721-a2c6-a1c943c13d82 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] 10.222.0.62 "GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b" status: 200 len: 1554 microversion: 2.1 time: 0.162634 Aug 10 11:33:46.751783 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 83/161] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:46 2022] GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:46.787726 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-82733421-d30d-4c83-ac56-465b3b6a0595 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:46.796272 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-82733421-d30d-4c83-ac56-465b3b6a0595 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1521 microversion: 2.1 time: 0.158598 Aug 10 11:33:46.797099 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 79/162] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:46 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:33:47.423533 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-374811f3-924d-4eb7-8f9c-85a3aa0eba96 req-51350967-e52c-4025-b6ca-a65a35f0cd0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "420b7baa-d100-4d8d-973f-3b29beebba6b", "name": "network-vif-unplugged", "status": "completed", "tag": "b777f638-0433-408a-abe4-fd50173e4085"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:33:47.433392 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-374811f3-924d-4eb7-8f9c-85a3aa0eba96 req-51350967-e52c-4025-b6ca-a65a35f0cd0a service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:47.433865 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-374811f3-924d-4eb7-8f9c-85a3aa0eba96 req-51350967-e52c-4025-b6ca-a65a35f0cd0a service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:47.434296 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-374811f3-924d-4eb7-8f9c-85a3aa0eba96 req-51350967-e52c-4025-b6ca-a65a35f0cd0a service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:47.445746 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-374811f3-924d-4eb7-8f9c-85a3aa0eba96 req-51350967-e52c-4025-b6ca-a65a35f0cd0a service nova] Creating event network-vif-unplugged:b777f638-0433-408a-abe4-fd50173e4085 for instance 420b7baa-d100-4d8d-973f-3b29beebba6b on hv-cinder-85272 Aug 10 11:33:47.450822 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-374811f3-924d-4eb7-8f9c-85a3aa0eba96 req-51350967-e52c-4025-b6ca-a65a35f0cd0a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033011 Aug 10 11:33:47.452066 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 84/163] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:33:47.773376 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-bb9d8dd0-06d1-4d5e-a076-e25b8af8b7f0 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:47.773988 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-bb9d8dd0-06d1-4d5e-a076-e25b8af8b7f0 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] [instance: 420b7baa-d100-4d8d-973f-3b29beebba6b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:47.781377 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bb9d8dd0-06d1-4d5e-a076-e25b8af8b7f0 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:47.781859 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bb9d8dd0-06d1-4d5e-a076-e25b8af8b7f0 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:47.782294 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bb9d8dd0-06d1-4d5e-a076-e25b8af8b7f0 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:47.782977 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bb9d8dd0-06d1-4d5e-a076-e25b8af8b7f0 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:47.783430 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bb9d8dd0-06d1-4d5e-a076-e25b8af8b7f0 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:47.783854 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bb9d8dd0-06d1-4d5e-a076-e25b8af8b7f0 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:47.817216 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-91b31ed4-c44a-4d8c-b4e5-5e20928e8789 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:47.818109 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-91b31ed4-c44a-4d8c-b4e5-5e20928e8789 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:47.829889 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-91b31ed4-c44a-4d8c-b4e5-5e20928e8789 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:47.829889 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-91b31ed4-c44a-4d8c-b4e5-5e20928e8789 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:47.829889 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-91b31ed4-c44a-4d8c-b4e5-5e20928e8789 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:47.830548 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-91b31ed4-c44a-4d8c-b4e5-5e20928e8789 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:47.831211 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-91b31ed4-c44a-4d8c-b4e5-5e20928e8789 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:47.831835 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-91b31ed4-c44a-4d8c-b4e5-5e20928e8789 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:47.919219 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-bb9d8dd0-06d1-4d5e-a076-e25b8af8b7f0 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12ec9d7cfec45ebbf390765794cbad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d79610ecd1460182af0946d8beba5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:47.928316 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-bb9d8dd0-06d1-4d5e-a076-e25b8af8b7f0 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] 10.222.0.62 "GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b" status: 200 len: 1554 microversion: 2.1 time: 0.158728 Aug 10 11:33:47.929005 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 80/164] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:47 2022] GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:47.967566 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-91b31ed4-c44a-4d8c-b4e5-5e20928e8789 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:47.975114 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-91b31ed4-c44a-4d8c-b4e5-5e20928e8789 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1521 microversion: 2.1 time: 0.162411 Aug 10 11:33:47.976226 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 85/165] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:47 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:33:48.949115 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-950cb230-cd80-4d1b-90c6-0782e6e1b8d0 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:48.949791 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-950cb230-cd80-4d1b-90c6-0782e6e1b8d0 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] [instance: 420b7baa-d100-4d8d-973f-3b29beebba6b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:48.958543 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-950cb230-cd80-4d1b-90c6-0782e6e1b8d0 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:48.959170 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-950cb230-cd80-4d1b-90c6-0782e6e1b8d0 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:48.959477 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-950cb230-cd80-4d1b-90c6-0782e6e1b8d0 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:48.960211 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-950cb230-cd80-4d1b-90c6-0782e6e1b8d0 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:48.960671 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-950cb230-cd80-4d1b-90c6-0782e6e1b8d0 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:48.961090 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-950cb230-cd80-4d1b-90c6-0782e6e1b8d0 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:48.996716 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-d3e5038a-a09d-4a2d-b7a6-37e73bd8f978 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:49.003999 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-d3e5038a-a09d-4a2d-b7a6-37e73bd8f978 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:49.006645 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d3e5038a-a09d-4a2d-b7a6-37e73bd8f978 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:49.007340 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d3e5038a-a09d-4a2d-b7a6-37e73bd8f978 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:49.008063 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d3e5038a-a09d-4a2d-b7a6-37e73bd8f978 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:49.009243 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d3e5038a-a09d-4a2d-b7a6-37e73bd8f978 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:49.009914 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d3e5038a-a09d-4a2d-b7a6-37e73bd8f978 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:49.010353 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d3e5038a-a09d-4a2d-b7a6-37e73bd8f978 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:49.036218 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-950cb230-cd80-4d1b-90c6-0782e6e1b8d0 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12ec9d7cfec45ebbf390765794cbad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d79610ecd1460182af0946d8beba5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:49.052996 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-950cb230-cd80-4d1b-90c6-0782e6e1b8d0 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] 10.222.0.62 "GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b" status: 200 len: 1512 microversion: 2.1 time: 0.107681 Aug 10 11:33:49.064164 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 81/166] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:48 2022] GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b => generated 1512 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:49.064164 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-e06bc607-5bdd-42b8-a28e-8e027c8e6a60 req-48f0f798-19b1-424d-b6c3-bd933f782ceb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "420b7baa-d100-4d8d-973f-3b29beebba6b", "name": "network-vif-deleted", "tag": "b777f638-0433-408a-abe4-fd50173e4085"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:33:49.074171 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-e06bc607-5bdd-42b8-a28e-8e027c8e6a60 req-48f0f798-19b1-424d-b6c3-bd933f782ceb service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:49.074701 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-e06bc607-5bdd-42b8-a28e-8e027c8e6a60 req-48f0f798-19b1-424d-b6c3-bd933f782ceb service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:49.075326 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-e06bc607-5bdd-42b8-a28e-8e027c8e6a60 req-48f0f798-19b1-424d-b6c3-bd933f782ceb service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:49.088773 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-e06bc607-5bdd-42b8-a28e-8e027c8e6a60 req-48f0f798-19b1-424d-b6c3-bd933f782ceb service nova] Creating event network-vif-deleted:b777f638-0433-408a-abe4-fd50173e4085 for instance 420b7baa-d100-4d8d-973f-3b29beebba6b on hv-cinder-85272 Aug 10 11:33:49.094704 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-e06bc607-5bdd-42b8-a28e-8e027c8e6a60 req-48f0f798-19b1-424d-b6c3-bd933f782ceb service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039901 Aug 10 11:33:49.096032 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 82/167] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:33:49.175652 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-d3e5038a-a09d-4a2d-b7a6-37e73bd8f978 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:49.184626 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-d3e5038a-a09d-4a2d-b7a6-37e73bd8f978 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1521 microversion: 2.1 time: 0.192903 Aug 10 11:33:49.185869 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 86/168] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:48 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:33:50.080937 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-edfadb4b-b70d-4181-9fce-471c7b0c7e0d tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:50.081784 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-edfadb4b-b70d-4181-9fce-471c7b0c7e0d tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] [instance: 420b7baa-d100-4d8d-973f-3b29beebba6b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:50.088227 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-edfadb4b-b70d-4181-9fce-471c7b0c7e0d tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:50.088750 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-edfadb4b-b70d-4181-9fce-471c7b0c7e0d tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:50.089194 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-edfadb4b-b70d-4181-9fce-471c7b0c7e0d tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:50.089895 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-edfadb4b-b70d-4181-9fce-471c7b0c7e0d tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:50.090368 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-edfadb4b-b70d-4181-9fce-471c7b0c7e0d tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:50.090803 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-edfadb4b-b70d-4181-9fce-471c7b0c7e0d tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:50.126401 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-edfadb4b-b70d-4181-9fce-471c7b0c7e0d tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:50.126978 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-edfadb4b-b70d-4181-9fce-471c7b0c7e0d tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:50.127547 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-edfadb4b-b70d-4181-9fce-471c7b0c7e0d tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:50.128040 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.objects.instance [None req-edfadb4b-b70d-4181-9fce-471c7b0c7e0d tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lazy-loading 'fault' on Instance uuid 420b7baa-d100-4d8d-973f-3b29beebba6b {{(pid=124682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:33:50.195853 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-edfadb4b-b70d-4181-9fce-471c7b0c7e0d tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12ec9d7cfec45ebbf390765794cbad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d79610ecd1460182af0946d8beba5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:50.206707 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-bd07fbaf-8272-48eb-bd6c-f7400433cc25 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:50.209041 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-bd07fbaf-8272-48eb-bd6c-f7400433cc25 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:50.209174 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-edfadb4b-b70d-4181-9fce-471c7b0c7e0d tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] 10.222.0.62 "GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b" status: 200 len: 1351 microversion: 2.1 time: 0.133095 Aug 10 11:33:50.209683 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 83/169] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:50 2022] GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b => generated 1351 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:50.227274 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bd07fbaf-8272-48eb-bd6c-f7400433cc25 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:50.228045 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bd07fbaf-8272-48eb-bd6c-f7400433cc25 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:50.232230 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bd07fbaf-8272-48eb-bd6c-f7400433cc25 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:50.232230 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bd07fbaf-8272-48eb-bd6c-f7400433cc25 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:50.232230 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bd07fbaf-8272-48eb-bd6c-f7400433cc25 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:50.232230 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bd07fbaf-8272-48eb-bd6c-f7400433cc25 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:50.490020 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-bd07fbaf-8272-48eb-bd6c-f7400433cc25 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:50.498186 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-bd07fbaf-8272-48eb-bd6c-f7400433cc25 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1521 microversion: 2.1 time: 0.295200 Aug 10 11:33:50.499077 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 87/170] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:50 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1521 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:33:51.230492 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-04cb700e-f14f-435e-bcc2-c70956847fcc tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:51.231210 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-04cb700e-f14f-435e-bcc2-c70956847fcc tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] [instance: 420b7baa-d100-4d8d-973f-3b29beebba6b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:51.238092 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-04cb700e-f14f-435e-bcc2-c70956847fcc tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:51.238667 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-04cb700e-f14f-435e-bcc2-c70956847fcc tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:51.239106 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-04cb700e-f14f-435e-bcc2-c70956847fcc tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:51.239799 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-04cb700e-f14f-435e-bcc2-c70956847fcc tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:51.240351 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-04cb700e-f14f-435e-bcc2-c70956847fcc tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:51.240777 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-04cb700e-f14f-435e-bcc2-c70956847fcc tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:51.254960 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.wsgi [None req-04cb700e-f14f-435e-bcc2-c70956847fcc tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] HTTP exception thrown: Instance 420b7baa-d100-4d8d-973f-3b29beebba6b could not be found. Aug 10 11:33:51.270382 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-04cb700e-f14f-435e-bcc2-c70956847fcc tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Request method failure captured: Aug 10 11:33:51.270382 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: request: GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b HTTP/1.1 Aug 10 11:33:51.270382 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Accept: application/json Aug 10 11:33:51.270382 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Aug 10 11:33:51.270382 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Connection: close Aug 10 11:33:51.270382 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Content-Length: 0 Aug 10 11:33:51.270382 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Content-Type: application/json Aug 10 11:33:51.270382 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Host: 10.222.0.62 Aug 10 11:33:51.270382 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Aug 10 11:33:51.270382 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.11 Aug 10 11:33:51.270382 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABi85dfWRuRIOSChiMWoBb9WH7vxx91QOIYuopSQcNMeaPA64UjNPWt2bK4DH0UH0OY9OzBLei3XTTlzz6Cl_3M30fspFSwpgv5MQGr44ngLZF_OxR2CdVcmU3S_IbGLeo1z6rZtAtm5_SDViwUz_jKpnTu7ke9AKjcTEneriBb0Uu68Xw Aug 10 11:33:51.270382 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Aug 10 11:33:51.270382 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Aug 10 11:33:51.270382 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Aug 10 11:33:51.270382 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Aug 10 11:33:51.270382 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Aug 10 11:33:51.270382 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Aug 10 11:33:51.270382 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Id: 34d79610ecd1460182af0946d8beba5f Aug 10 11:33:51.270382 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-DeleteServersTestJSON-234489286 Aug 10 11:33:51.270382 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Role: member,reader Aug 10 11:33:51.270382 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Aug 10 11:33:51.271941 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/34d79610ecd1460182af0946d8beba5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_34d79610ecd1460182af0946d8beba5f", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/34d79610ecd1460182af0946d8beba5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/34d79610ecd1460182af0946d8beba5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:33:51.271941 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-DeleteServersTestJSON-234489286 Aug 10 11:33:51.271941 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant-Id: 34d79610ecd1460182af0946d8beba5f Aug 10 11:33:51.271941 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-DeleteServersTestJSON-234489286 Aug 10 11:33:51.271941 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User: tempest-DeleteServersTestJSON-234489286-project Aug 10 11:33:51.271941 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Aug 10 11:33:51.271941 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Aug 10 11:33:51.271941 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Id: c12ec9d7cfec45ebbf390765794cbad5 Aug 10 11:33:51.271941 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-DeleteServersTestJSON-234489286-project Aug 10 11:33:51.271941 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: method: > Aug 10 11:33:51.271941 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: exception: Instance 420b7baa-d100-4d8d-973f-3b29beebba6b could not be found. Aug 10 11:33:51.271941 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: action_args: {'id': '420b7baa-d100-4d8d-973f-3b29beebba6b'} Aug 10 11:33:51.272915 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:33:51.272915 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:33:51.272915 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:33:51.272915 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:33:51.272915 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:33:51.272915 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:33:51.272915 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:33:51.272915 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:33:51.272915 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:33:51.272915 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:33:51.272915 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 420b7baa-d100-4d8d-973f-3b29beebba6b could not be found. Aug 10 11:33:51.272915 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:33:51.272915 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:33:51.272915 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:33:51.272915 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:33:51.272915 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:33:51.272915 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:33:51.272915 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:33:51.272915 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:33:51.272915 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:33:51.274344 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:33:51.274344 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:33:51.274344 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:33:51.274344 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:33:51.274344 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:33:51.274344 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:33:51.274344 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:33:51.274344 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 420b7baa-d100-4d8d-973f-3b29beebba6b could not be found. Aug 10 11:33:51.274344 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:33:51.274344 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:33:51.274344 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:33:51.274344 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:33:51.274344 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:33:51.274344 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:33:51.274344 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:33:51.274344 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:33:51.274344 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 420b7baa-d100-4d8d-973f-3b29beebba6b could not be found. Aug 10 11:33:51.274344 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:33:51.275576 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-04cb700e-f14f-435e-bcc2-c70956847fcc tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Returning 404 to user: Instance 420b7baa-d100-4d8d-973f-3b29beebba6b could not be found. {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:33:51.275576 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-04cb700e-f14f-435e-bcc2-c70956847fcc tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] 10.222.0.62 "GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b" status: 404 len: 111 microversion: 2.1 time: 0.045275 Aug 10 11:33:51.275576 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 84/171] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:51 2022] GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:33:51.391221 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-bd5ef206-72d1-4c7e-b5b4-58b354a07434 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:51.393400 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-bd5ef206-72d1-4c7e-b5b4-58b354a07434 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] [instance: 420b7baa-d100-4d8d-973f-3b29beebba6b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:51.399446 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bd5ef206-72d1-4c7e-b5b4-58b354a07434 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:51.399933 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bd5ef206-72d1-4c7e-b5b4-58b354a07434 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:51.400404 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bd5ef206-72d1-4c7e-b5b4-58b354a07434 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:51.401175 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bd5ef206-72d1-4c7e-b5b4-58b354a07434 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:51.401782 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bd5ef206-72d1-4c7e-b5b4-58b354a07434 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:51.401988 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bd5ef206-72d1-4c7e-b5b4-58b354a07434 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:51.415395 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-bd5ef206-72d1-4c7e-b5b4-58b354a07434 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] HTTP exception thrown: Instance 420b7baa-d100-4d8d-973f-3b29beebba6b could not be found. Aug 10 11:33:51.419495 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-bd5ef206-72d1-4c7e-b5b4-58b354a07434 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Request method failure captured: Aug 10 11:33:51.419495 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: request: GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b/os-volume_attachments HTTP/1.1 Aug 10 11:33:51.419495 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept: application/json Aug 10 11:33:51.419495 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Aug 10 11:33:51.419495 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Connection: close Aug 10 11:33:51.419495 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Length: 0 Aug 10 11:33:51.419495 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Type: application/json Aug 10 11:33:51.419495 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Host: 10.222.0.62 Aug 10 11:33:51.419495 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Aug 10 11:33:51.419495 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.11 Aug 10 11:33:51.419495 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABi85dfWRuRIOSChiMWoBb9WH7vxx91QOIYuopSQcNMeaPA64UjNPWt2bK4DH0UH0OY9OzBLei3XTTlzz6Cl_3M30fspFSwpgv5MQGr44ngLZF_OxR2CdVcmU3S_IbGLeo1z6rZtAtm5_SDViwUz_jKpnTu7ke9AKjcTEneriBb0Uu68Xw Aug 10 11:33:51.419495 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Aug 10 11:33:51.419495 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Aug 10 11:33:51.419495 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Aug 10 11:33:51.419495 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Aug 10 11:33:51.419495 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Aug 10 11:33:51.419495 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Aug 10 11:33:51.419495 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Id: 34d79610ecd1460182af0946d8beba5f Aug 10 11:33:51.419495 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-DeleteServersTestJSON-234489286 Aug 10 11:33:51.419495 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Role: member,reader Aug 10 11:33:51.419495 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Aug 10 11:33:51.421011 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/34d79610ecd1460182af0946d8beba5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_34d79610ecd1460182af0946d8beba5f", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/34d79610ecd1460182af0946d8beba5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/34d79610ecd1460182af0946d8beba5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:33:51.421011 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-DeleteServersTestJSON-234489286 Aug 10 11:33:51.421011 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Id: 34d79610ecd1460182af0946d8beba5f Aug 10 11:33:51.421011 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-DeleteServersTestJSON-234489286 Aug 10 11:33:51.421011 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User: tempest-DeleteServersTestJSON-234489286-project Aug 10 11:33:51.421011 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Aug 10 11:33:51.421011 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Aug 10 11:33:51.421011 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Id: c12ec9d7cfec45ebbf390765794cbad5 Aug 10 11:33:51.421011 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-DeleteServersTestJSON-234489286-project Aug 10 11:33:51.421011 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: method: > Aug 10 11:33:51.421011 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: exception: Instance 420b7baa-d100-4d8d-973f-3b29beebba6b could not be found. Aug 10 11:33:51.421011 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: action_args: {'server_id': '420b7baa-d100-4d8d-973f-3b29beebba6b'} Aug 10 11:33:51.422038 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:33:51.422038 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:33:51.422038 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:33:51.422038 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:33:51.422038 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:33:51.422038 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:33:51.422038 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:33:51.422038 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:33:51.422038 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:33:51.422038 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:33:51.422038 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 420b7baa-d100-4d8d-973f-3b29beebba6b could not be found. Aug 10 11:33:51.422038 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:33:51.422038 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:33:51.422038 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:33:51.422038 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:33:51.422038 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:33:51.422038 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:33:51.422038 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:33:51.422038 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:33:51.422038 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:33:51.423201 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:33:51.423201 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 11:33:51.423201 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 11:33:51.423201 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 11:33:51.423201 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 11:33:51.423201 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 10 11:33:51.423201 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 10 11:33:51.423201 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:33:51.423201 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:33:51.423201 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 420b7baa-d100-4d8d-973f-3b29beebba6b could not be found. Aug 10 11:33:51.423201 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:33:51.423201 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:33:51.423201 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:33:51.423201 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:33:51.423201 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:33:51.423201 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:33:51.423201 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:33:51.423201 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:33:51.423201 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 420b7baa-d100-4d8d-973f-3b29beebba6b could not be found. Aug 10 11:33:51.423201 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:33:51.424603 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-bd5ef206-72d1-4c7e-b5b4-58b354a07434 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Returning 404 to user: Instance 420b7baa-d100-4d8d-973f-3b29beebba6b could not be found. {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:33:51.424603 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-bd5ef206-72d1-4c7e-b5b4-58b354a07434 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] 10.222.0.62 "GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034720 Aug 10 11:33:51.424603 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 88/172] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 10 11:33:51 2022] GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:33:51.526059 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-fcf09e3c-08cc-42ee-bf94-ca707d5e1ee4 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:51.526716 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-fcf09e3c-08cc-42ee-bf94-ca707d5e1ee4 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:51.533644 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fcf09e3c-08cc-42ee-bf94-ca707d5e1ee4 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:51.537741 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fcf09e3c-08cc-42ee-bf94-ca707d5e1ee4 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:51.537741 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fcf09e3c-08cc-42ee-bf94-ca707d5e1ee4 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:51.537741 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fcf09e3c-08cc-42ee-bf94-ca707d5e1ee4 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:51.537741 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fcf09e3c-08cc-42ee-bf94-ca707d5e1ee4 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:51.538178 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fcf09e3c-08cc-42ee-bf94-ca707d5e1ee4 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:51.685478 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-fcf09e3c-08cc-42ee-bf94-ca707d5e1ee4 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:51.692876 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-fcf09e3c-08cc-42ee-bf94-ca707d5e1ee4 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1521 microversion: 2.1 time: 0.170591 Aug 10 11:33:51.693460 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 85/173] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:51 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:52.715529 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-3ed04691-0a13-4b05-8560-c5c30607f7a8 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:52.715913 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-3ed04691-0a13-4b05-8560-c5c30607f7a8 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:52.722447 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3ed04691-0a13-4b05-8560-c5c30607f7a8 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:52.722931 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3ed04691-0a13-4b05-8560-c5c30607f7a8 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:52.723365 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3ed04691-0a13-4b05-8560-c5c30607f7a8 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:52.724084 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3ed04691-0a13-4b05-8560-c5c30607f7a8 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:52.724540 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3ed04691-0a13-4b05-8560-c5c30607f7a8 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:52.724962 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3ed04691-0a13-4b05-8560-c5c30607f7a8 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:52.866855 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-3ed04691-0a13-4b05-8560-c5c30607f7a8 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:52.874713 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-3ed04691-0a13-4b05-8560-c5c30607f7a8 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1521 microversion: 2.1 time: 0.163689 Aug 10 11:33:52.879129 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 89/174] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:52 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:53.896053 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-b8958352-bb62-46f1-a075-99c012dfe908 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:53.896571 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-b8958352-bb62-46f1-a075-99c012dfe908 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:53.903594 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b8958352-bb62-46f1-a075-99c012dfe908 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:53.904165 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b8958352-bb62-46f1-a075-99c012dfe908 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:53.905259 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b8958352-bb62-46f1-a075-99c012dfe908 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:53.906027 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b8958352-bb62-46f1-a075-99c012dfe908 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:53.906500 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b8958352-bb62-46f1-a075-99c012dfe908 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:53.906927 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b8958352-bb62-46f1-a075-99c012dfe908 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:54.042734 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b8958352-bb62-46f1-a075-99c012dfe908 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:54.051074 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-b8958352-bb62-46f1-a075-99c012dfe908 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1521 microversion: 2.1 time: 0.159141 Aug 10 11:33:54.051702 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 86/175] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:53 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:54.996641 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-ba039d3a-6485-4a31-94f9-05854ba4f8f6 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:54.997232 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-ba039d3a-6485-4a31-94f9-05854ba4f8f6 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] [instance: 420b7baa-d100-4d8d-973f-3b29beebba6b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:55.016288 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ba039d3a-6485-4a31-94f9-05854ba4f8f6 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:55.016288 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ba039d3a-6485-4a31-94f9-05854ba4f8f6 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:55.016288 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ba039d3a-6485-4a31-94f9-05854ba4f8f6 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:55.016288 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ba039d3a-6485-4a31-94f9-05854ba4f8f6 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:55.016793 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ba039d3a-6485-4a31-94f9-05854ba4f8f6 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:55.016793 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ba039d3a-6485-4a31-94f9-05854ba4f8f6 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:55.021167 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-ba039d3a-6485-4a31-94f9-05854ba4f8f6 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] HTTP exception thrown: Instance 420b7baa-d100-4d8d-973f-3b29beebba6b could not be found. Aug 10 11:33:55.023334 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-ba039d3a-6485-4a31-94f9-05854ba4f8f6 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Request method failure captured: Aug 10 11:33:55.023334 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: request: DELETE /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b HTTP/1.1 Aug 10 11:33:55.023334 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept: application/json Aug 10 11:33:55.023334 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Aug 10 11:33:55.023334 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Connection: close Aug 10 11:33:55.023334 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Length: 0 Aug 10 11:33:55.023334 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Type: application/json Aug 10 11:33:55.023334 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Host: 10.222.0.62 Aug 10 11:33:55.023334 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Aug 10 11:33:55.023334 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.11 Aug 10 11:33:55.023334 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABi85dfWRuRIOSChiMWoBb9WH7vxx91QOIYuopSQcNMeaPA64UjNPWt2bK4DH0UH0OY9OzBLei3XTTlzz6Cl_3M30fspFSwpgv5MQGr44ngLZF_OxR2CdVcmU3S_IbGLeo1z6rZtAtm5_SDViwUz_jKpnTu7ke9AKjcTEneriBb0Uu68Xw Aug 10 11:33:55.023334 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Aug 10 11:33:55.023334 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Aug 10 11:33:55.023334 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Aug 10 11:33:55.023334 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Aug 10 11:33:55.023334 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Aug 10 11:33:55.023334 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Aug 10 11:33:55.023334 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Id: 34d79610ecd1460182af0946d8beba5f Aug 10 11:33:55.023334 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-DeleteServersTestJSON-234489286 Aug 10 11:33:55.023334 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Role: member,reader Aug 10 11:33:55.023334 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Aug 10 11:33:55.024946 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/34d79610ecd1460182af0946d8beba5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_34d79610ecd1460182af0946d8beba5f", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/34d79610ecd1460182af0946d8beba5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/34d79610ecd1460182af0946d8beba5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:33:55.024946 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-DeleteServersTestJSON-234489286 Aug 10 11:33:55.024946 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Id: 34d79610ecd1460182af0946d8beba5f Aug 10 11:33:55.024946 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-DeleteServersTestJSON-234489286 Aug 10 11:33:55.024946 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User: tempest-DeleteServersTestJSON-234489286-project Aug 10 11:33:55.024946 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Aug 10 11:33:55.024946 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Aug 10 11:33:55.024946 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Id: c12ec9d7cfec45ebbf390765794cbad5 Aug 10 11:33:55.024946 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-DeleteServersTestJSON-234489286-project Aug 10 11:33:55.024946 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: method: > Aug 10 11:33:55.024946 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: exception: Instance 420b7baa-d100-4d8d-973f-3b29beebba6b could not be found. Aug 10 11:33:55.024946 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: action_args: {'id': '420b7baa-d100-4d8d-973f-3b29beebba6b'} Aug 10 11:33:55.025816 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:33:55.025816 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:33:55.025816 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:33:55.025816 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:33:55.025816 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:33:55.025816 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:33:55.025816 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:33:55.025816 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:33:55.025816 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:33:55.025816 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:33:55.025816 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 420b7baa-d100-4d8d-973f-3b29beebba6b could not be found. Aug 10 11:33:55.025816 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:33:55.025816 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:33:55.025816 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:33:55.025816 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:33:55.025816 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:33:55.025816 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:33:55.025816 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:33:55.025816 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:33:55.025816 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:33:55.026929 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:33:55.026929 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 11:33:55.026929 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 11:33:55.026929 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 11:33:55.026929 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 11:33:55.026929 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:33:55.026929 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:33:55.026929 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:33:55.026929 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:33:55.026929 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 420b7baa-d100-4d8d-973f-3b29beebba6b could not be found. Aug 10 11:33:55.026929 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:33:55.026929 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:33:55.026929 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:33:55.026929 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:33:55.026929 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:33:55.026929 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:33:55.026929 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:33:55.026929 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:33:55.026929 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 420b7baa-d100-4d8d-973f-3b29beebba6b could not be found. Aug 10 11:33:55.026929 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:33:55.028480 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-ba039d3a-6485-4a31-94f9-05854ba4f8f6 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Returning 404 to user: Instance 420b7baa-d100-4d8d-973f-3b29beebba6b could not be found. {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:33:55.028480 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-ba039d3a-6485-4a31-94f9-05854ba4f8f6 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] 10.222.0.62 "DELETE /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b" status: 404 len: 111 microversion: 2.1 time: 0.032163 Aug 10 11:33:55.028480 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 90/176] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 10 11:33:54 2022] DELETE /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:33:55.035220 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-6e3e06de-51aa-49b6-b9eb-012721846874 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:55.035911 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-6e3e06de-51aa-49b6-b9eb-012721846874 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] [instance: 420b7baa-d100-4d8d-973f-3b29beebba6b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:55.044642 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6e3e06de-51aa-49b6-b9eb-012721846874 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:55.045130 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6e3e06de-51aa-49b6-b9eb-012721846874 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:55.046113 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6e3e06de-51aa-49b6-b9eb-012721846874 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:55.046842 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6e3e06de-51aa-49b6-b9eb-012721846874 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:55.047491 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6e3e06de-51aa-49b6-b9eb-012721846874 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:55.048635 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6e3e06de-51aa-49b6-b9eb-012721846874 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:55.073718 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-5f360636-d4a7-46bb-b2fe-8e6f3f240d78 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:55.074335 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-5f360636-d4a7-46bb-b2fe-8e6f3f240d78 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:55.079647 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.wsgi [None req-6e3e06de-51aa-49b6-b9eb-012721846874 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] HTTP exception thrown: Instance 420b7baa-d100-4d8d-973f-3b29beebba6b could not be found. Aug 10 11:33:55.080718 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5f360636-d4a7-46bb-b2fe-8e6f3f240d78 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:55.081578 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5f360636-d4a7-46bb-b2fe-8e6f3f240d78 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:55.082175 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-6e3e06de-51aa-49b6-b9eb-012721846874 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Request method failure captured: Aug 10 11:33:55.082175 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: request: GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b HTTP/1.1 Aug 10 11:33:55.082175 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Accept: application/json Aug 10 11:33:55.082175 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Aug 10 11:33:55.082175 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Connection: close Aug 10 11:33:55.082175 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Content-Length: 0 Aug 10 11:33:55.082175 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Content-Type: application/json Aug 10 11:33:55.082175 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Host: 10.222.0.62 Aug 10 11:33:55.082175 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Aug 10 11:33:55.082175 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.11 Aug 10 11:33:55.082175 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABi85dfWRuRIOSChiMWoBb9WH7vxx91QOIYuopSQcNMeaPA64UjNPWt2bK4DH0UH0OY9OzBLei3XTTlzz6Cl_3M30fspFSwpgv5MQGr44ngLZF_OxR2CdVcmU3S_IbGLeo1z6rZtAtm5_SDViwUz_jKpnTu7ke9AKjcTEneriBb0Uu68Xw Aug 10 11:33:55.082175 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Aug 10 11:33:55.082175 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Aug 10 11:33:55.082175 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Aug 10 11:33:55.082175 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Aug 10 11:33:55.082175 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Aug 10 11:33:55.082175 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Aug 10 11:33:55.082175 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Id: 34d79610ecd1460182af0946d8beba5f Aug 10 11:33:55.082175 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-DeleteServersTestJSON-234489286 Aug 10 11:33:55.082175 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Role: member,reader Aug 10 11:33:55.082175 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Aug 10 11:33:55.083628 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/34d79610ecd1460182af0946d8beba5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_34d79610ecd1460182af0946d8beba5f", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/34d79610ecd1460182af0946d8beba5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/34d79610ecd1460182af0946d8beba5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:33:55.083628 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-DeleteServersTestJSON-234489286 Aug 10 11:33:55.083628 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant-Id: 34d79610ecd1460182af0946d8beba5f Aug 10 11:33:55.083628 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-DeleteServersTestJSON-234489286 Aug 10 11:33:55.083628 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User: tempest-DeleteServersTestJSON-234489286-project Aug 10 11:33:55.083628 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Aug 10 11:33:55.083628 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Aug 10 11:33:55.083628 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Id: c12ec9d7cfec45ebbf390765794cbad5 Aug 10 11:33:55.083628 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-DeleteServersTestJSON-234489286-project Aug 10 11:33:55.083628 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: method: > Aug 10 11:33:55.083628 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: exception: Instance 420b7baa-d100-4d8d-973f-3b29beebba6b could not be found. Aug 10 11:33:55.083628 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: action_args: {'id': '420b7baa-d100-4d8d-973f-3b29beebba6b'} Aug 10 11:33:55.088151 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:33:55.088151 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:33:55.088151 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:33:55.088151 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:33:55.088151 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:33:55.088151 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:33:55.088151 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:33:55.088151 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:33:55.088151 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:33:55.088151 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:33:55.088151 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 420b7baa-d100-4d8d-973f-3b29beebba6b could not be found. Aug 10 11:33:55.088151 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:33:55.088151 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:33:55.088151 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:33:55.088151 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:33:55.088151 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:33:55.088151 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:33:55.088151 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:33:55.088151 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:33:55.088151 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:33:55.089854 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:33:55.089854 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:33:55.089854 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:33:55.089854 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:33:55.089854 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:33:55.089854 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:33:55.089854 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:33:55.089854 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 420b7baa-d100-4d8d-973f-3b29beebba6b could not be found. Aug 10 11:33:55.089854 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:33:55.089854 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:33:55.089854 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:33:55.089854 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:33:55.089854 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:33:55.089854 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:33:55.089854 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:33:55.089854 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:33:55.089854 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 420b7baa-d100-4d8d-973f-3b29beebba6b could not be found. Aug 10 11:33:55.089854 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:33:55.091055 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-6e3e06de-51aa-49b6-b9eb-012721846874 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] Returning 404 to user: Instance 420b7baa-d100-4d8d-973f-3b29beebba6b could not be found. {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:33:55.091626 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5f360636-d4a7-46bb-b2fe-8e6f3f240d78 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:55.091739 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-6e3e06de-51aa-49b6-b9eb-012721846874 tempest-DeleteServersTestJSON-234489286 tempest-DeleteServersTestJSON-234489286-project] 10.222.0.62 "GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b" status: 404 len: 111 microversion: 2.1 time: 0.054519 Aug 10 11:33:55.091880 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5f360636-d4a7-46bb-b2fe-8e6f3f240d78 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:55.091880 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5f360636-d4a7-46bb-b2fe-8e6f3f240d78 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:55.091880 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5f360636-d4a7-46bb-b2fe-8e6f3f240d78 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:55.103161 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 87/177] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:55 2022] GET /compute/v2.1/servers/420b7baa-d100-4d8d-973f-3b29beebba6b => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:33:55.374271 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-5f360636-d4a7-46bb-b2fe-8e6f3f240d78 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:55.383227 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-5f360636-d4a7-46bb-b2fe-8e6f3f240d78 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1521 microversion: 2.1 time: 0.314792 Aug 10 11:33:55.393675 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 91/178] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:55 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:56.404955 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-f680dbc4-2447-4e64-87ff-e3aa2ee123b8 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:56.405581 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-f680dbc4-2447-4e64-87ff-e3aa2ee123b8 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:56.413660 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f680dbc4-2447-4e64-87ff-e3aa2ee123b8 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:56.414190 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f680dbc4-2447-4e64-87ff-e3aa2ee123b8 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:56.414640 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f680dbc4-2447-4e64-87ff-e3aa2ee123b8 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:56.415641 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f680dbc4-2447-4e64-87ff-e3aa2ee123b8 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:56.415792 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f680dbc4-2447-4e64-87ff-e3aa2ee123b8 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:56.416436 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f680dbc4-2447-4e64-87ff-e3aa2ee123b8 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:56.421205 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:33:56.596558 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-f680dbc4-2447-4e64-87ff-e3aa2ee123b8 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:56.604485 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-f680dbc4-2447-4e64-87ff-e3aa2ee123b8 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1521 microversion: 2.1 time: 0.204074 Aug 10 11:33:56.612105 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 88/179] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:56 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:57.626340 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-bb4dc65f-f1eb-43c0-b3ae-f53130a7d794 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:57.626950 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-bb4dc65f-f1eb-43c0-b3ae-f53130a7d794 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:57.633003 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bb4dc65f-f1eb-43c0-b3ae-f53130a7d794 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:57.633479 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bb4dc65f-f1eb-43c0-b3ae-f53130a7d794 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:57.633912 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bb4dc65f-f1eb-43c0-b3ae-f53130a7d794 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:57.634697 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bb4dc65f-f1eb-43c0-b3ae-f53130a7d794 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:57.635146 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bb4dc65f-f1eb-43c0-b3ae-f53130a7d794 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:57.635565 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bb4dc65f-f1eb-43c0-b3ae-f53130a7d794 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:57.640947 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=100 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:33:57.802405 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-bb4dc65f-f1eb-43c0-b3ae-f53130a7d794 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:57.810026 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-bb4dc65f-f1eb-43c0-b3ae-f53130a7d794 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1521 microversion: 2.1 time: 0.188845 Aug 10 11:33:57.810588 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 92/180] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:57 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:58.831814 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-70441b87-9ece-4068-8b51-b45b5caf4f0e tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:58.832602 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-70441b87-9ece-4068-8b51-b45b5caf4f0e tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:58.845289 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-70441b87-9ece-4068-8b51-b45b5caf4f0e tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:58.849698 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-70441b87-9ece-4068-8b51-b45b5caf4f0e tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:58.850153 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-70441b87-9ece-4068-8b51-b45b5caf4f0e tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:58.850889 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-70441b87-9ece-4068-8b51-b45b5caf4f0e tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:58.851417 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-70441b87-9ece-4068-8b51-b45b5caf4f0e tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:58.851791 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-70441b87-9ece-4068-8b51-b45b5caf4f0e tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:59.142810 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-70441b87-9ece-4068-8b51-b45b5caf4f0e tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:59.150703 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-70441b87-9ece-4068-8b51-b45b5caf4f0e tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1521 microversion: 2.1 time: 0.323243 Aug 10 11:33:59.151439 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 89/181] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:58 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1521 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:34:00.177202 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-99d72ece-b388-4846-a97b-d257e122310c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:00.177823 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-99d72ece-b388-4846-a97b-d257e122310c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:00.184153 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-99d72ece-b388-4846-a97b-d257e122310c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:00.184578 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-99d72ece-b388-4846-a97b-d257e122310c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:00.185013 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-99d72ece-b388-4846-a97b-d257e122310c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:00.186333 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-99d72ece-b388-4846-a97b-d257e122310c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:00.186793 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-99d72ece-b388-4846-a97b-d257e122310c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:00.187391 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-99d72ece-b388-4846-a97b-d257e122310c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:00.377582 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-99d72ece-b388-4846-a97b-d257e122310c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:00.386960 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-99d72ece-b388-4846-a97b-d257e122310c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1521 microversion: 2.1 time: 0.213487 Aug 10 11:34:00.388181 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 93/182] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:34:00 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:34:01.411734 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-11488ce8-a892-4e6c-aa53-cf24427301ed tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:01.412511 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-11488ce8-a892-4e6c-aa53-cf24427301ed tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:01.419047 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-11488ce8-a892-4e6c-aa53-cf24427301ed tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:01.419528 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-11488ce8-a892-4e6c-aa53-cf24427301ed tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:01.419985 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-11488ce8-a892-4e6c-aa53-cf24427301ed tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:01.420727 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-11488ce8-a892-4e6c-aa53-cf24427301ed tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:01.421149 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-11488ce8-a892-4e6c-aa53-cf24427301ed tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:01.421646 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-11488ce8-a892-4e6c-aa53-cf24427301ed tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:01.566319 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-11488ce8-a892-4e6c-aa53-cf24427301ed tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:01.574121 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-11488ce8-a892-4e6c-aa53-cf24427301ed tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1521 microversion: 2.1 time: 0.166545 Aug 10 11:34:01.574687 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 90/183] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:34:01 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:34:02.596824 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-2c2d21d3-7e4b-4cb0-9d67-3b30b432223d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:02.598144 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-2c2d21d3-7e4b-4cb0-9d67-3b30b432223d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:02.604037 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2c2d21d3-7e4b-4cb0-9d67-3b30b432223d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:02.604517 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2c2d21d3-7e4b-4cb0-9d67-3b30b432223d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:02.605131 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2c2d21d3-7e4b-4cb0-9d67-3b30b432223d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:02.605866 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2c2d21d3-7e4b-4cb0-9d67-3b30b432223d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:02.606316 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2c2d21d3-7e4b-4cb0-9d67-3b30b432223d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:02.607114 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2c2d21d3-7e4b-4cb0-9d67-3b30b432223d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:02.819655 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-2c2d21d3-7e4b-4cb0-9d67-3b30b432223d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:02.829089 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-2c2d21d3-7e4b-4cb0-9d67-3b30b432223d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1521 microversion: 2.1 time: 0.237881 Aug 10 11:34:02.851950 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 94/184] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:34:02 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:34:03.851748 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-d8d2e276-7223-41a6-8f8e-d4a63b1a727c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:03.852599 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-d8d2e276-7223-41a6-8f8e-d4a63b1a727c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:03.860785 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d8d2e276-7223-41a6-8f8e-d4a63b1a727c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:03.861267 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d8d2e276-7223-41a6-8f8e-d4a63b1a727c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:03.861709 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d8d2e276-7223-41a6-8f8e-d4a63b1a727c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:03.862555 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d8d2e276-7223-41a6-8f8e-d4a63b1a727c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:03.863202 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d8d2e276-7223-41a6-8f8e-d4a63b1a727c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:03.863632 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d8d2e276-7223-41a6-8f8e-d4a63b1a727c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:04.044570 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-d8d2e276-7223-41a6-8f8e-d4a63b1a727c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:04.055462 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-d8d2e276-7223-41a6-8f8e-d4a63b1a727c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1521 microversion: 2.1 time: 0.207330 Aug 10 11:34:04.056233 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 91/185] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:34:03 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:34:05.082091 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-b5b707eb-8d25-41d4-b0d7-57cd4dae31a7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:05.082844 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-b5b707eb-8d25-41d4-b0d7-57cd4dae31a7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:05.088931 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b5b707eb-8d25-41d4-b0d7-57cd4dae31a7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:05.089413 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b5b707eb-8d25-41d4-b0d7-57cd4dae31a7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:05.096471 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b5b707eb-8d25-41d4-b0d7-57cd4dae31a7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:05.096471 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b5b707eb-8d25-41d4-b0d7-57cd4dae31a7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:05.096471 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b5b707eb-8d25-41d4-b0d7-57cd4dae31a7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:05.096471 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b5b707eb-8d25-41d4-b0d7-57cd4dae31a7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:05.226702 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-b5b707eb-8d25-41d4-b0d7-57cd4dae31a7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:05.234642 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-b5b707eb-8d25-41d4-b0d7-57cd4dae31a7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1521 microversion: 2.1 time: 0.156639 Aug 10 11:34:05.235214 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 95/186] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:34:05 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:34:06.261208 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-66c14b7b-b07c-4579-b488-f75bfa7d7f02 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:06.261849 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-66c14b7b-b07c-4579-b488-f75bfa7d7f02 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:06.268664 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-66c14b7b-b07c-4579-b488-f75bfa7d7f02 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:06.269224 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-66c14b7b-b07c-4579-b488-f75bfa7d7f02 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:06.269662 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-66c14b7b-b07c-4579-b488-f75bfa7d7f02 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:06.270348 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-66c14b7b-b07c-4579-b488-f75bfa7d7f02 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:06.270803 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-66c14b7b-b07c-4579-b488-f75bfa7d7f02 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:06.271228 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-66c14b7b-b07c-4579-b488-f75bfa7d7f02 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:06.405688 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-66c14b7b-b07c-4579-b488-f75bfa7d7f02 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:06.413092 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-66c14b7b-b07c-4579-b488-f75bfa7d7f02 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1521 microversion: 2.1 time: 0.155819 Aug 10 11:34:06.413631 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 92/187] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:34:06 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:34:07.434381 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-44d96884-ca3d-433a-87b5-e7410d1f2a11 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:07.434972 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-44d96884-ca3d-433a-87b5-e7410d1f2a11 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:07.441153 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-44d96884-ca3d-433a-87b5-e7410d1f2a11 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:07.441642 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-44d96884-ca3d-433a-87b5-e7410d1f2a11 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:07.442077 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-44d96884-ca3d-433a-87b5-e7410d1f2a11 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:07.442771 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-44d96884-ca3d-433a-87b5-e7410d1f2a11 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:07.443228 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-44d96884-ca3d-433a-87b5-e7410d1f2a11 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:07.443655 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-44d96884-ca3d-433a-87b5-e7410d1f2a11 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:07.569068 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-44d96884-ca3d-433a-87b5-e7410d1f2a11 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:07.576514 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-44d96884-ca3d-433a-87b5-e7410d1f2a11 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1521 microversion: 2.1 time: 0.146200 Aug 10 11:34:07.577701 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 96/188] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:34:07 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:34:08.608942 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-41a80964-ffbe-42c2-871d-1ae059c33bb3 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:08.608942 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-41a80964-ffbe-42c2-871d-1ae059c33bb3 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:08.608942 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-41a80964-ffbe-42c2-871d-1ae059c33bb3 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:08.608942 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-41a80964-ffbe-42c2-871d-1ae059c33bb3 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:08.609870 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-41a80964-ffbe-42c2-871d-1ae059c33bb3 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:08.609870 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-41a80964-ffbe-42c2-871d-1ae059c33bb3 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:08.609870 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-41a80964-ffbe-42c2-871d-1ae059c33bb3 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:08.609870 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-41a80964-ffbe-42c2-871d-1ae059c33bb3 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:08.875753 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-41a80964-ffbe-42c2-871d-1ae059c33bb3 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:08.883540 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-41a80964-ffbe-42c2-871d-1ae059c33bb3 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1521 microversion: 2.1 time: 0.288983 Aug 10 11:34:08.884160 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 93/189] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:34:08 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:34:09.907476 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-d1c01eb0-05e6-4af0-b868-dc5ed743990d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:09.908462 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-d1c01eb0-05e6-4af0-b868-dc5ed743990d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:09.916375 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d1c01eb0-05e6-4af0-b868-dc5ed743990d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:09.916794 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d1c01eb0-05e6-4af0-b868-dc5ed743990d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:09.917225 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d1c01eb0-05e6-4af0-b868-dc5ed743990d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:09.917920 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d1c01eb0-05e6-4af0-b868-dc5ed743990d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:09.918367 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d1c01eb0-05e6-4af0-b868-dc5ed743990d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:09.918790 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d1c01eb0-05e6-4af0-b868-dc5ed743990d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:10.064848 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-d1c01eb0-05e6-4af0-b868-dc5ed743990d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:10.074959 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-d1c01eb0-05e6-4af0-b868-dc5ed743990d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1521 microversion: 2.1 time: 0.171643 Aug 10 11:34:10.080664 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 97/190] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:34:09 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:34:11.099390 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-f836a621-6e60-4bf6-bee6-0aa7707b32ee tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:11.100083 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-f836a621-6e60-4bf6-bee6-0aa7707b32ee tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:11.106447 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f836a621-6e60-4bf6-bee6-0aa7707b32ee tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:11.106934 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f836a621-6e60-4bf6-bee6-0aa7707b32ee tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:11.107416 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f836a621-6e60-4bf6-bee6-0aa7707b32ee tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:11.108136 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f836a621-6e60-4bf6-bee6-0aa7707b32ee tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:11.108595 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f836a621-6e60-4bf6-bee6-0aa7707b32ee tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:11.109134 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f836a621-6e60-4bf6-bee6-0aa7707b32ee tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:11.235773 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-f836a621-6e60-4bf6-bee6-0aa7707b32ee tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:11.243182 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-f836a621-6e60-4bf6-bee6-0aa7707b32ee tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1521 microversion: 2.1 time: 0.147646 Aug 10 11:34:11.243756 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 94/191] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:34:11 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:34:12.264756 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-54ceb68d-f8ea-4b72-8bda-92f00705ed0b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:12.266230 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-54ceb68d-f8ea-4b72-8bda-92f00705ed0b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:12.271951 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-54ceb68d-f8ea-4b72-8bda-92f00705ed0b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:12.272457 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-54ceb68d-f8ea-4b72-8bda-92f00705ed0b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:12.272894 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-54ceb68d-f8ea-4b72-8bda-92f00705ed0b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:12.273579 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-54ceb68d-f8ea-4b72-8bda-92f00705ed0b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:12.274032 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-54ceb68d-f8ea-4b72-8bda-92f00705ed0b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:12.274456 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-54ceb68d-f8ea-4b72-8bda-92f00705ed0b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:12.403517 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-54ceb68d-f8ea-4b72-8bda-92f00705ed0b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:12.411407 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-54ceb68d-f8ea-4b72-8bda-92f00705ed0b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1521 microversion: 2.1 time: 0.150743 Aug 10 11:34:12.411991 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 98/192] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:34:12 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:34:13.434266 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-bea690ca-87c0-4cb1-bdc4-9a17fc80c99a tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:13.434266 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-bea690ca-87c0-4cb1-bdc4-9a17fc80c99a tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:13.437072 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=44 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:34:13.441850 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bea690ca-87c0-4cb1-bdc4-9a17fc80c99a tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:13.442331 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bea690ca-87c0-4cb1-bdc4-9a17fc80c99a tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:13.442764 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bea690ca-87c0-4cb1-bdc4-9a17fc80c99a tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:13.443457 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bea690ca-87c0-4cb1-bdc4-9a17fc80c99a tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:13.443904 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bea690ca-87c0-4cb1-bdc4-9a17fc80c99a tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:13.444357 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bea690ca-87c0-4cb1-bdc4-9a17fc80c99a tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:13.590000 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-bea690ca-87c0-4cb1-bdc4-9a17fc80c99a tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:13.597742 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-bea690ca-87c0-4cb1-bdc4-9a17fc80c99a tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1521 microversion: 2.1 time: 0.168925 Aug 10 11:34:13.598350 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 95/193] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:34:13 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:34:14.618542 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-fe9bc78a-4cf5-4cfc-8401-f43f15b2cf51 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:14.619608 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-fe9bc78a-4cf5-4cfc-8401-f43f15b2cf51 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:14.622320 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=36 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:34:14.626489 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fe9bc78a-4cf5-4cfc-8401-f43f15b2cf51 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:14.626979 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fe9bc78a-4cf5-4cfc-8401-f43f15b2cf51 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:14.627443 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fe9bc78a-4cf5-4cfc-8401-f43f15b2cf51 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:14.628173 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fe9bc78a-4cf5-4cfc-8401-f43f15b2cf51 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:14.628631 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fe9bc78a-4cf5-4cfc-8401-f43f15b2cf51 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:14.629059 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fe9bc78a-4cf5-4cfc-8401-f43f15b2cf51 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:14.763565 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-fe9bc78a-4cf5-4cfc-8401-f43f15b2cf51 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:14.771781 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-fe9bc78a-4cf5-4cfc-8401-f43f15b2cf51 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1521 microversion: 2.1 time: 0.157028 Aug 10 11:34:14.772363 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 99/194] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:34:14 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:34:15.792717 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-70f8c6bf-b563-4b6b-b3fb-0ce5d1a14de7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:15.793320 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-70f8c6bf-b563-4b6b-b3fb-0ce5d1a14de7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:15.800670 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-70f8c6bf-b563-4b6b-b3fb-0ce5d1a14de7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:15.801154 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-70f8c6bf-b563-4b6b-b3fb-0ce5d1a14de7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:15.801586 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-70f8c6bf-b563-4b6b-b3fb-0ce5d1a14de7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:15.802269 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-70f8c6bf-b563-4b6b-b3fb-0ce5d1a14de7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:15.802717 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-70f8c6bf-b563-4b6b-b3fb-0ce5d1a14de7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:15.803229 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-70f8c6bf-b563-4b6b-b3fb-0ce5d1a14de7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:15.941300 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-70f8c6bf-b563-4b6b-b3fb-0ce5d1a14de7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:15.948961 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-70f8c6bf-b563-4b6b-b3fb-0ce5d1a14de7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1521 microversion: 2.1 time: 0.160040 Aug 10 11:34:15.949536 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 96/195] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:34:15 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:34:16.970543 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-e418a094-7536-419c-bc48-7fb1f5ef071d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:16.971151 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-e418a094-7536-419c-bc48-7fb1f5ef071d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:16.977088 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e418a094-7536-419c-bc48-7fb1f5ef071d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:16.977572 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e418a094-7536-419c-bc48-7fb1f5ef071d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:16.978006 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e418a094-7536-419c-bc48-7fb1f5ef071d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:16.978694 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e418a094-7536-419c-bc48-7fb1f5ef071d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:16.979147 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e418a094-7536-419c-bc48-7fb1f5ef071d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:16.979568 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e418a094-7536-419c-bc48-7fb1f5ef071d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:17.134131 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-e418a094-7536-419c-bc48-7fb1f5ef071d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:17.142772 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-e418a094-7536-419c-bc48-7fb1f5ef071d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1521 microversion: 2.1 time: 0.176682 Aug 10 11:34:17.143349 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 100/196] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:34:16 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:34:18.164836 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-4481bea3-9105-4f90-9a7d-11dbc764ba00 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:18.165958 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-4481bea3-9105-4f90-9a7d-11dbc764ba00 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:18.172913 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4481bea3-9105-4f90-9a7d-11dbc764ba00 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:18.173523 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4481bea3-9105-4f90-9a7d-11dbc764ba00 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:18.174033 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4481bea3-9105-4f90-9a7d-11dbc764ba00 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:18.174741 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4481bea3-9105-4f90-9a7d-11dbc764ba00 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:18.175201 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4481bea3-9105-4f90-9a7d-11dbc764ba00 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:18.175634 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4481bea3-9105-4f90-9a7d-11dbc764ba00 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:18.305671 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-4481bea3-9105-4f90-9a7d-11dbc764ba00 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:18.313872 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-4481bea3-9105-4f90-9a7d-11dbc764ba00 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1521 microversion: 2.1 time: 0.152981 Aug 10 11:34:18.314432 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 97/197] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:34:18 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:34:19.334524 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-1545373c-9d48-4eba-8d4c-6fc8aad345aa tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:19.335140 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-1545373c-9d48-4eba-8d4c-6fc8aad345aa tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:19.341067 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1545373c-9d48-4eba-8d4c-6fc8aad345aa tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:19.341548 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1545373c-9d48-4eba-8d4c-6fc8aad345aa tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:19.341983 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1545373c-9d48-4eba-8d4c-6fc8aad345aa tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:19.342663 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1545373c-9d48-4eba-8d4c-6fc8aad345aa tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:19.343731 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1545373c-9d48-4eba-8d4c-6fc8aad345aa tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:19.344316 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1545373c-9d48-4eba-8d4c-6fc8aad345aa tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:19.472682 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-1545373c-9d48-4eba-8d4c-6fc8aad345aa tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:19.480265 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-1545373c-9d48-4eba-8d4c-6fc8aad345aa tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1521 microversion: 2.1 time: 0.149546 Aug 10 11:34:19.480910 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 101/198] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:34:19 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:34:20.501268 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-ca4d1bf2-fb38-461e-847f-69730b070bb8 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:20.502013 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-ca4d1bf2-fb38-461e-847f-69730b070bb8 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:20.508293 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ca4d1bf2-fb38-461e-847f-69730b070bb8 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:20.508783 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ca4d1bf2-fb38-461e-847f-69730b070bb8 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:20.509220 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ca4d1bf2-fb38-461e-847f-69730b070bb8 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:20.514001 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ca4d1bf2-fb38-461e-847f-69730b070bb8 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:20.514001 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ca4d1bf2-fb38-461e-847f-69730b070bb8 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:20.514001 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ca4d1bf2-fb38-461e-847f-69730b070bb8 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:20.645566 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-ca4d1bf2-fb38-461e-847f-69730b070bb8 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:20.656784 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-ca4d1bf2-fb38-461e-847f-69730b070bb8 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1521 microversion: 2.1 time: 0.158357 Aug 10 11:34:20.657595 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 98/199] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:34:20 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:34:21.682612 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-5cf9a4a8-81bc-4a27-b2e2-39e6d664f170 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:21.683591 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-5cf9a4a8-81bc-4a27-b2e2-39e6d664f170 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:21.692065 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5cf9a4a8-81bc-4a27-b2e2-39e6d664f170 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:21.692702 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5cf9a4a8-81bc-4a27-b2e2-39e6d664f170 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:21.693168 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5cf9a4a8-81bc-4a27-b2e2-39e6d664f170 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:21.694015 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5cf9a4a8-81bc-4a27-b2e2-39e6d664f170 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:21.694472 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5cf9a4a8-81bc-4a27-b2e2-39e6d664f170 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:21.694893 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5cf9a4a8-81bc-4a27-b2e2-39e6d664f170 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:21.844185 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-5cf9a4a8-81bc-4a27-b2e2-39e6d664f170 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:21.863501 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-5cf9a4a8-81bc-4a27-b2e2-39e6d664f170 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1501 microversion: 2.1 time: 0.174450 Aug 10 11:34:21.863501 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 102/200] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:34:21 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1501 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:34:21.874080 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-6e0763ee-3080-45b6-91b2-746e093283a3 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:21.874914 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-6e0763ee-3080-45b6-91b2-746e093283a3 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 85d76c52-fcda-4805-aa95-a00f88e39970] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:21.881687 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6e0763ee-3080-45b6-91b2-746e093283a3 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:21.885147 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6e0763ee-3080-45b6-91b2-746e093283a3 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:21.885147 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6e0763ee-3080-45b6-91b2-746e093283a3 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:21.885147 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6e0763ee-3080-45b6-91b2-746e093283a3 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:21.885147 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6e0763ee-3080-45b6-91b2-746e093283a3 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:21.885579 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6e0763ee-3080-45b6-91b2-746e093283a3 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:22.032579 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-6e0763ee-3080-45b6-91b2-746e093283a3 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:22.040153 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-6e0763ee-3080-45b6-91b2-746e093283a3 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970" status: 200 len: 1515 microversion: 2.1 time: 0.170134 Aug 10 11:34:22.040714 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 99/201] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:34:21 2022] GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970 => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:34:24.053069 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-11febcbb-5dbf-416f-be5a-602398562497 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:34:24.056086 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-11febcbb-5dbf-416f-be5a-602398562497 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 85d76c52-fcda-4805-aa95-a00f88e39970] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:24.064141 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-11febcbb-5dbf-416f-be5a-602398562497 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:24.064141 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-11febcbb-5dbf-416f-be5a-602398562497 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:24.064935 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-11febcbb-5dbf-416f-be5a-602398562497 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:24.065713 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-11febcbb-5dbf-416f-be5a-602398562497 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:24.066371 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-11febcbb-5dbf-416f-be5a-602398562497 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:24.069105 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-11febcbb-5dbf-416f-be5a-602398562497 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:24.103215 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.objects.instance [None req-11febcbb-5dbf-416f-be5a-602398562497 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lazy-loading 'flavor' on Instance uuid 85d76c52-fcda-4805-aa95-a00f88e39970 {{(pid=124683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:34:24.453699 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-11febcbb-5dbf-416f-be5a-602398562497 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "POST /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970/action" status: 200 len: 32 microversion: 2.1 time: 0.404563 Aug 10 11:34:24.454871 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 103/202] 10.222.0.62 () {60 vars in 1278 bytes} [Wed Aug 10 11:34:24 2022] POST /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970/action => generated 32 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 11:34:24.464913 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-ab5b5af6-05d5-42d3-af8d-8b610a8d1fdf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:24.465488 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-ab5b5af6-05d5-42d3-af8d-8b610a8d1fdf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 85d76c52-fcda-4805-aa95-a00f88e39970] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:24.473672 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ab5b5af6-05d5-42d3-af8d-8b610a8d1fdf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:24.474741 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ab5b5af6-05d5-42d3-af8d-8b610a8d1fdf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:24.475178 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ab5b5af6-05d5-42d3-af8d-8b610a8d1fdf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:24.475878 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ab5b5af6-05d5-42d3-af8d-8b610a8d1fdf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:24.476357 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ab5b5af6-05d5-42d3-af8d-8b610a8d1fdf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:24.476821 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ab5b5af6-05d5-42d3-af8d-8b610a8d1fdf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:24.649891 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-ab5b5af6-05d5-42d3-af8d-8b610a8d1fdf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:24.675836 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-ab5b5af6-05d5-42d3-af8d-8b610a8d1fdf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970" status: 200 len: 1521 microversion: 2.1 time: 0.215240 Aug 10 11:34:24.684859 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 100/203] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:34:24 2022] GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:34:25.700350 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-78311f2c-fb0c-4ad0-bbc9-c35023b55cff tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:25.701196 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-78311f2c-fb0c-4ad0-bbc9-c35023b55cff tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 85d76c52-fcda-4805-aa95-a00f88e39970] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:25.708487 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-78311f2c-fb0c-4ad0-bbc9-c35023b55cff tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:25.709068 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-78311f2c-fb0c-4ad0-bbc9-c35023b55cff tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:25.709663 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-78311f2c-fb0c-4ad0-bbc9-c35023b55cff tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:25.710565 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-78311f2c-fb0c-4ad0-bbc9-c35023b55cff tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:25.711089 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-78311f2c-fb0c-4ad0-bbc9-c35023b55cff tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:25.711581 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-78311f2c-fb0c-4ad0-bbc9-c35023b55cff tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:25.859391 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-78311f2c-fb0c-4ad0-bbc9-c35023b55cff tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:25.867228 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-78311f2c-fb0c-4ad0-bbc9-c35023b55cff tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970" status: 200 len: 1521 microversion: 2.1 time: 0.172106 Aug 10 11:34:25.867789 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 104/204] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:34:25 2022] GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:34:26.893834 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-22c849a6-f55e-4fa0-acd1-d56b96527dc1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:26.894889 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-22c849a6-f55e-4fa0-acd1-d56b96527dc1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 85d76c52-fcda-4805-aa95-a00f88e39970] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:26.912006 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-22c849a6-f55e-4fa0-acd1-d56b96527dc1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:26.912509 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-22c849a6-f55e-4fa0-acd1-d56b96527dc1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:26.912946 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-22c849a6-f55e-4fa0-acd1-d56b96527dc1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:26.913677 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-22c849a6-f55e-4fa0-acd1-d56b96527dc1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:26.914132 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-22c849a6-f55e-4fa0-acd1-d56b96527dc1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:26.914557 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-22c849a6-f55e-4fa0-acd1-d56b96527dc1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:27.070551 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-22c849a6-f55e-4fa0-acd1-d56b96527dc1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:27.078571 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-22c849a6-f55e-4fa0-acd1-d56b96527dc1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970" status: 200 len: 1521 microversion: 2.1 time: 0.192173 Aug 10 11:34:27.079104 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 101/205] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:34:26 2022] GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:34:28.099506 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-6bc7450c-58a5-4fa2-b6cb-5799af00195d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:28.100319 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-6bc7450c-58a5-4fa2-b6cb-5799af00195d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 85d76c52-fcda-4805-aa95-a00f88e39970] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:28.106482 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6bc7450c-58a5-4fa2-b6cb-5799af00195d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:28.106965 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6bc7450c-58a5-4fa2-b6cb-5799af00195d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:28.107406 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6bc7450c-58a5-4fa2-b6cb-5799af00195d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:28.108120 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6bc7450c-58a5-4fa2-b6cb-5799af00195d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:28.109067 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6bc7450c-58a5-4fa2-b6cb-5799af00195d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:28.113901 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6bc7450c-58a5-4fa2-b6cb-5799af00195d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:28.113901 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:34:28.258644 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-6bc7450c-58a5-4fa2-b6cb-5799af00195d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:28.262101 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-6bc7450c-58a5-4fa2-b6cb-5799af00195d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970" status: 200 len: 1521 microversion: 2.1 time: 0.166533 Aug 10 11:34:28.262685 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 105/206] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:34:28 2022] GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:34:29.282789 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-388115f6-2faf-4b79-841b-5b3ecefcc025 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:29.283398 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-388115f6-2faf-4b79-841b-5b3ecefcc025 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 85d76c52-fcda-4805-aa95-a00f88e39970] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:29.289504 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-388115f6-2faf-4b79-841b-5b3ecefcc025 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:29.291918 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-388115f6-2faf-4b79-841b-5b3ecefcc025 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:29.291918 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-388115f6-2faf-4b79-841b-5b3ecefcc025 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:29.291918 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-388115f6-2faf-4b79-841b-5b3ecefcc025 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:29.291918 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-388115f6-2faf-4b79-841b-5b3ecefcc025 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:29.292300 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-388115f6-2faf-4b79-841b-5b3ecefcc025 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:29.439931 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-388115f6-2faf-4b79-841b-5b3ecefcc025 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:29.447548 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-388115f6-2faf-4b79-841b-5b3ecefcc025 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970" status: 200 len: 1521 microversion: 2.1 time: 0.168698 Aug 10 11:34:29.448488 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 102/207] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:34:29 2022] GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:34:30.470794 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-ed593ef3-7380-41c1-aa75-93b884fec7d2 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:30.471754 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-ed593ef3-7380-41c1-aa75-93b884fec7d2 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 85d76c52-fcda-4805-aa95-a00f88e39970] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:30.480647 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ed593ef3-7380-41c1-aa75-93b884fec7d2 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:30.481153 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ed593ef3-7380-41c1-aa75-93b884fec7d2 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:30.481598 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ed593ef3-7380-41c1-aa75-93b884fec7d2 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:30.482316 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ed593ef3-7380-41c1-aa75-93b884fec7d2 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:30.482772 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ed593ef3-7380-41c1-aa75-93b884fec7d2 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:30.483238 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ed593ef3-7380-41c1-aa75-93b884fec7d2 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:30.627933 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-ed593ef3-7380-41c1-aa75-93b884fec7d2 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:30.635711 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-ed593ef3-7380-41c1-aa75-93b884fec7d2 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970" status: 200 len: 1521 microversion: 2.1 time: 0.169758 Aug 10 11:34:30.636513 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 106/208] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:34:30 2022] GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:34:31.658886 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-909a1a09-16a7-4958-ac73-3588c14dd1f7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:31.659447 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-909a1a09-16a7-4958-ac73-3588c14dd1f7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 85d76c52-fcda-4805-aa95-a00f88e39970] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:31.665963 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-909a1a09-16a7-4958-ac73-3588c14dd1f7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:31.668525 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-909a1a09-16a7-4958-ac73-3588c14dd1f7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:31.668525 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-909a1a09-16a7-4958-ac73-3588c14dd1f7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:31.668525 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-909a1a09-16a7-4958-ac73-3588c14dd1f7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:31.668525 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-909a1a09-16a7-4958-ac73-3588c14dd1f7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:31.668841 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-909a1a09-16a7-4958-ac73-3588c14dd1f7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:31.672286 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=89 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:34:31.808350 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-909a1a09-16a7-4958-ac73-3588c14dd1f7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:31.815761 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-909a1a09-16a7-4958-ac73-3588c14dd1f7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970" status: 200 len: 1521 microversion: 2.1 time: 0.161345 Aug 10 11:34:31.816378 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 103/209] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:34:31 2022] GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:34:32.837454 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-2d24c627-7314-47f5-beb2-703a82f1c0d4 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:32.838094 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-2d24c627-7314-47f5-beb2-703a82f1c0d4 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 85d76c52-fcda-4805-aa95-a00f88e39970] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:32.844470 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2d24c627-7314-47f5-beb2-703a82f1c0d4 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:32.844958 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2d24c627-7314-47f5-beb2-703a82f1c0d4 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:32.845417 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2d24c627-7314-47f5-beb2-703a82f1c0d4 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:32.847383 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2d24c627-7314-47f5-beb2-703a82f1c0d4 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:32.847704 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2d24c627-7314-47f5-beb2-703a82f1c0d4 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:32.848208 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2d24c627-7314-47f5-beb2-703a82f1c0d4 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:32.980102 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-2d24c627-7314-47f5-beb2-703a82f1c0d4 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:32.987898 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-2d24c627-7314-47f5-beb2-703a82f1c0d4 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970" status: 200 len: 1521 microversion: 2.1 time: 0.154395 Aug 10 11:34:32.988497 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 107/210] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:34:32 2022] GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:34:33.863807 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-e1d13bad-27fd-4fac-90f2-6b5d11d6cbba tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:33.863807 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-e1d13bad-27fd-4fac-90f2-6b5d11d6cbba tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:33.875592 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e1d13bad-27fd-4fac-90f2-6b5d11d6cbba tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:33.888107 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e1d13bad-27fd-4fac-90f2-6b5d11d6cbba tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:33.889642 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e1d13bad-27fd-4fac-90f2-6b5d11d6cbba tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:33.894064 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e1d13bad-27fd-4fac-90f2-6b5d11d6cbba tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:33.900103 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e1d13bad-27fd-4fac-90f2-6b5d11d6cbba tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:33.900103 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e1d13bad-27fd-4fac-90f2-6b5d11d6cbba tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:33.925090 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-e1d13bad-27fd-4fac-90f2-6b5d11d6cbba tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05/ips" status: 200 len: 152 microversion: 2.20 time: 0.070631 Aug 10 11:34:33.934797 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 104/211] 10.222.0.62 () {60 vars in 1289 bytes} [Wed Aug 10 11:34:33 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05/ips => generated 152 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:34:34.015936 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-ce791244-58d2-480f-b4e2-8a93f0ed55b8 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:34.017878 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-ce791244-58d2-480f-b4e2-8a93f0ed55b8 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 85d76c52-fcda-4805-aa95-a00f88e39970] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:34.027219 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ce791244-58d2-480f-b4e2-8a93f0ed55b8 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:34.031173 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ce791244-58d2-480f-b4e2-8a93f0ed55b8 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:34.036872 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ce791244-58d2-480f-b4e2-8a93f0ed55b8 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:34.036872 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ce791244-58d2-480f-b4e2-8a93f0ed55b8 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:34.036872 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ce791244-58d2-480f-b4e2-8a93f0ed55b8 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:34.036872 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ce791244-58d2-480f-b4e2-8a93f0ed55b8 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:34.185648 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-ce791244-58d2-480f-b4e2-8a93f0ed55b8 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:34.194075 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-ce791244-58d2-480f-b4e2-8a93f0ed55b8 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970" status: 200 len: 1521 microversion: 2.1 time: 0.187805 Aug 10 11:34:34.200021 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 108/212] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:34:34 2022] GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:34:35.214751 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-907b7849-6fd6-4fde-ad43-748897a5fe5d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:35.215358 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-907b7849-6fd6-4fde-ad43-748897a5fe5d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 85d76c52-fcda-4805-aa95-a00f88e39970] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:35.221835 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-907b7849-6fd6-4fde-ad43-748897a5fe5d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:35.222312 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-907b7849-6fd6-4fde-ad43-748897a5fe5d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:35.222962 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-907b7849-6fd6-4fde-ad43-748897a5fe5d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:35.223668 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-907b7849-6fd6-4fde-ad43-748897a5fe5d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:35.224153 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-907b7849-6fd6-4fde-ad43-748897a5fe5d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:35.224676 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-907b7849-6fd6-4fde-ad43-748897a5fe5d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:35.364737 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-907b7849-6fd6-4fde-ad43-748897a5fe5d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:35.373073 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-907b7849-6fd6-4fde-ad43-748897a5fe5d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970" status: 200 len: 1521 microversion: 2.1 time: 0.162048 Aug 10 11:34:35.375043 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 105/213] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:34:35 2022] GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:34:36.395544 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-b25a105b-97df-4795-9e57-d6f0165c72d7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:36.396183 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-b25a105b-97df-4795-9e57-d6f0165c72d7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 85d76c52-fcda-4805-aa95-a00f88e39970] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:36.402038 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b25a105b-97df-4795-9e57-d6f0165c72d7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:36.402515 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b25a105b-97df-4795-9e57-d6f0165c72d7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:36.402992 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b25a105b-97df-4795-9e57-d6f0165c72d7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:36.403691 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b25a105b-97df-4795-9e57-d6f0165c72d7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:36.404165 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b25a105b-97df-4795-9e57-d6f0165c72d7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:36.404590 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b25a105b-97df-4795-9e57-d6f0165c72d7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:36.534482 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-b25a105b-97df-4795-9e57-d6f0165c72d7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:36.541933 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-b25a105b-97df-4795-9e57-d6f0165c72d7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970" status: 200 len: 1521 microversion: 2.1 time: 0.151495 Aug 10 11:34:36.542507 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 109/214] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:34:36 2022] GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:34:37.000158 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-07bd3173-ff88-4820-96fe-b55672f869a6 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:37.000701 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-07bd3173-ff88-4820-96fe-b55672f869a6 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:37.016633 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-07bd3173-ff88-4820-96fe-b55672f869a6 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:37.016633 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-07bd3173-ff88-4820-96fe-b55672f869a6 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:37.016633 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-07bd3173-ff88-4820-96fe-b55672f869a6 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:37.016633 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-07bd3173-ff88-4820-96fe-b55672f869a6 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:37.017399 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-07bd3173-ff88-4820-96fe-b55672f869a6 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:37.017399 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-07bd3173-ff88-4820-96fe-b55672f869a6 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:37.038069 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-07bd3173-ff88-4820-96fe-b55672f869a6 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3/ips" status: 200 len: 147 microversion: 2.1 time: 0.042012 Aug 10 11:34:37.038669 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 106/215] 10.222.0.62 () {58 vars in 1248 bytes} [Wed Aug 10 11:34:36 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3/ips => generated 147 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:34:37.529041 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f3e36698-35b4-4b88-ad15-912ac9e7ece3 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:34:37.529629 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-f3e36698-35b4-4b88-ad15-912ac9e7ece3 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:37.536269 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f3e36698-35b4-4b88-ad15-912ac9e7ece3 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:37.536500 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f3e36698-35b4-4b88-ad15-912ac9e7ece3 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:37.536922 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f3e36698-35b4-4b88-ad15-912ac9e7ece3 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:37.537885 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f3e36698-35b4-4b88-ad15-912ac9e7ece3 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:37.538399 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f3e36698-35b4-4b88-ad15-912ac9e7ece3 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:37.538589 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f3e36698-35b4-4b88-ad15-912ac9e7ece3 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:37.562765 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-3a3003c0-f83a-440e-bebf-2fafaba345b2 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:37.563522 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-3a3003c0-f83a-440e-bebf-2fafaba345b2 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 85d76c52-fcda-4805-aa95-a00f88e39970] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:37.566599 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.objects.instance [None req-f3e36698-35b4-4b88-ad15-912ac9e7ece3 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lazy-loading 'flavor' on Instance uuid 9e6ed242-956f-4b14-8520-18920447bf05 {{(pid=124683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:34:37.572155 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3a3003c0-f83a-440e-bebf-2fafaba345b2 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:37.572727 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3a3003c0-f83a-440e-bebf-2fafaba345b2 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:37.573177 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3a3003c0-f83a-440e-bebf-2fafaba345b2 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:37.577845 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3a3003c0-f83a-440e-bebf-2fafaba345b2 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:37.577845 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3a3003c0-f83a-440e-bebf-2fafaba345b2 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:37.577845 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3a3003c0-f83a-440e-bebf-2fafaba345b2 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:37.806724 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-3a3003c0-f83a-440e-bebf-2fafaba345b2 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:37.815880 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-3a3003c0-f83a-440e-bebf-2fafaba345b2 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970" status: 200 len: 1521 microversion: 2.1 time: 0.257130 Aug 10 11:34:37.817995 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 107/216] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:34:37 2022] GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970 => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:34:38.070136 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-f3e36698-35b4-4b88-ad15-912ac9e7ece3 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "POST /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05/action" status: 202 len: 0 microversion: 2.20 time: 0.544738 Aug 10 11:34:38.070776 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 110/217] 10.222.0.62 () {62 vars in 1319 bytes} [Wed Aug 10 11:34:37 2022] POST /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05/action => generated 0 bytes in 546 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:34:38.082838 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-8649de7b-12fe-443e-b072-2dd962dca379 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:38.085300 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-8649de7b-12fe-443e-b072-2dd962dca379 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:38.092381 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8649de7b-12fe-443e-b072-2dd962dca379 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:38.093070 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8649de7b-12fe-443e-b072-2dd962dca379 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:38.093507 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8649de7b-12fe-443e-b072-2dd962dca379 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:38.094235 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8649de7b-12fe-443e-b072-2dd962dca379 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:38.094684 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8649de7b-12fe-443e-b072-2dd962dca379 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:38.095112 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8649de7b-12fe-443e-b072-2dd962dca379 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:38.261239 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-8649de7b-12fe-443e-b072-2dd962dca379 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:38.271376 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-8649de7b-12fe-443e-b072-2dd962dca379 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:38.272909 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-8649de7b-12fe-443e-b072-2dd962dca379 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:38.274064 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-8649de7b-12fe-443e-b072-2dd962dca379 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1723 microversion: 2.20 time: 0.198461 Aug 10 11:34:38.274770 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 108/218] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:34:38 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:34:38.838591 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-d06fbcc1-fdeb-4c2f-a2e0-8cf123cb2f19 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:38.839384 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-d06fbcc1-fdeb-4c2f-a2e0-8cf123cb2f19 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 85d76c52-fcda-4805-aa95-a00f88e39970] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:38.846159 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d06fbcc1-fdeb-4c2f-a2e0-8cf123cb2f19 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:38.847392 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d06fbcc1-fdeb-4c2f-a2e0-8cf123cb2f19 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:38.848103 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d06fbcc1-fdeb-4c2f-a2e0-8cf123cb2f19 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:38.848886 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d06fbcc1-fdeb-4c2f-a2e0-8cf123cb2f19 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:38.849427 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d06fbcc1-fdeb-4c2f-a2e0-8cf123cb2f19 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:38.850061 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d06fbcc1-fdeb-4c2f-a2e0-8cf123cb2f19 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:39.044962 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-d06fbcc1-fdeb-4c2f-a2e0-8cf123cb2f19 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:39.053264 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-d06fbcc1-fdeb-4c2f-a2e0-8cf123cb2f19 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970" status: 200 len: 1521 microversion: 2.1 time: 0.219554 Aug 10 11:34:39.054061 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 111/219] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:34:38 2022] GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:34:39.299667 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-b588e267-a291-45b8-96d5-bc751d37fe1d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:39.301072 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-b588e267-a291-45b8-96d5-bc751d37fe1d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:39.307469 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b588e267-a291-45b8-96d5-bc751d37fe1d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:39.308819 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b588e267-a291-45b8-96d5-bc751d37fe1d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:39.308819 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b588e267-a291-45b8-96d5-bc751d37fe1d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:39.309087 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b588e267-a291-45b8-96d5-bc751d37fe1d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:39.309540 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b588e267-a291-45b8-96d5-bc751d37fe1d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:39.309962 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b588e267-a291-45b8-96d5-bc751d37fe1d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:39.449827 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b588e267-a291-45b8-96d5-bc751d37fe1d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:39.459047 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b588e267-a291-45b8-96d5-bc751d37fe1d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:39.460655 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b588e267-a291-45b8-96d5-bc751d37fe1d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:39.461848 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-b588e267-a291-45b8-96d5-bc751d37fe1d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1723 microversion: 2.20 time: 0.166048 Aug 10 11:34:39.462400 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 109/220] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:34:39 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:34:40.074625 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f5642435-ace8-42ef-a121-95ddbe9acaa1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:40.078236 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-f5642435-ace8-42ef-a121-95ddbe9acaa1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 85d76c52-fcda-4805-aa95-a00f88e39970] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:40.082400 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f5642435-ace8-42ef-a121-95ddbe9acaa1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:40.083263 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f5642435-ace8-42ef-a121-95ddbe9acaa1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:40.083619 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f5642435-ace8-42ef-a121-95ddbe9acaa1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:40.084418 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f5642435-ace8-42ef-a121-95ddbe9acaa1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:40.085030 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f5642435-ace8-42ef-a121-95ddbe9acaa1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:40.085605 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f5642435-ace8-42ef-a121-95ddbe9acaa1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:40.267058 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-f5642435-ace8-42ef-a121-95ddbe9acaa1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:40.280587 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-f5642435-ace8-42ef-a121-95ddbe9acaa1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970" status: 200 len: 1521 microversion: 2.1 time: 0.204735 Aug 10 11:34:40.280587 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 112/221] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:34:40 2022] GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:34:40.486115 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-06d7a948-f27f-4ac6-8696-13db027e0b66 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:40.486729 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-06d7a948-f27f-4ac6-8696-13db027e0b66 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:40.494098 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-06d7a948-f27f-4ac6-8696-13db027e0b66 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:40.494579 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-06d7a948-f27f-4ac6-8696-13db027e0b66 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:40.495017 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-06d7a948-f27f-4ac6-8696-13db027e0b66 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:40.495713 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-06d7a948-f27f-4ac6-8696-13db027e0b66 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:40.496209 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-06d7a948-f27f-4ac6-8696-13db027e0b66 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:40.496637 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-06d7a948-f27f-4ac6-8696-13db027e0b66 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:40.632106 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-06d7a948-f27f-4ac6-8696-13db027e0b66 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:40.640675 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-06d7a948-f27f-4ac6-8696-13db027e0b66 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:40.642418 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-06d7a948-f27f-4ac6-8696-13db027e0b66 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:40.643598 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-06d7a948-f27f-4ac6-8696-13db027e0b66 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1723 microversion: 2.20 time: 0.161467 Aug 10 11:34:40.644390 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 110/222] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:34:40 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:34:41.299381 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-c779762d-d516-4d1a-a735-b5f305b9694f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:41.300216 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-c779762d-d516-4d1a-a735-b5f305b9694f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 85d76c52-fcda-4805-aa95-a00f88e39970] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:41.306131 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c779762d-d516-4d1a-a735-b5f305b9694f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:41.306620 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c779762d-d516-4d1a-a735-b5f305b9694f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:41.307273 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c779762d-d516-4d1a-a735-b5f305b9694f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:41.308053 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c779762d-d516-4d1a-a735-b5f305b9694f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:41.308678 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c779762d-d516-4d1a-a735-b5f305b9694f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:41.309253 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c779762d-d516-4d1a-a735-b5f305b9694f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:41.469118 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-c779762d-d516-4d1a-a735-b5f305b9694f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:41.476696 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-c779762d-d516-4d1a-a735-b5f305b9694f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970" status: 200 len: 1521 microversion: 2.1 time: 0.183901 Aug 10 11:34:41.477281 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 113/223] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:34:41 2022] GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:34:41.667263 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-c5912a89-befc-4b95-ab4b-6f6a6de3cd55 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:41.667986 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-c5912a89-befc-4b95-ab4b-6f6a6de3cd55 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:41.674765 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c5912a89-befc-4b95-ab4b-6f6a6de3cd55 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:41.675564 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c5912a89-befc-4b95-ab4b-6f6a6de3cd55 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:41.676125 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c5912a89-befc-4b95-ab4b-6f6a6de3cd55 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:41.676913 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c5912a89-befc-4b95-ab4b-6f6a6de3cd55 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:41.677537 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c5912a89-befc-4b95-ab4b-6f6a6de3cd55 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:41.678279 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c5912a89-befc-4b95-ab4b-6f6a6de3cd55 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:41.826705 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c5912a89-befc-4b95-ab4b-6f6a6de3cd55 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:41.839154 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c5912a89-befc-4b95-ab4b-6f6a6de3cd55 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:41.841170 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c5912a89-befc-4b95-ab4b-6f6a6de3cd55 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:41.842379 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-c5912a89-befc-4b95-ab4b-6f6a6de3cd55 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1723 microversion: 2.20 time: 0.179693 Aug 10 11:34:41.842943 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 111/224] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:34:41 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:34:42.377177 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-84812d0b-4107-4363-9073-ac932a6afbac tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9fde986d-5a28-4354-95ed-19abf35eab0e"}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:34:42.379908 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-84812d0b-4107-4363-9073-ac932a6afbac tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:42.385975 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-84812d0b-4107-4363-9073-ac932a6afbac tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:42.386468 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-84812d0b-4107-4363-9073-ac932a6afbac tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:42.386911 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-84812d0b-4107-4363-9073-ac932a6afbac tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:42.387612 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-84812d0b-4107-4363-9073-ac932a6afbac tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:42.388264 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-84812d0b-4107-4363-9073-ac932a6afbac tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:42.388695 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-84812d0b-4107-4363-9073-ac932a6afbac tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:42.499345 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-f3f68784-5a9a-4855-8e04-87f7b8fb4064 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:42.500009 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-f3f68784-5a9a-4855-8e04-87f7b8fb4064 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 85d76c52-fcda-4805-aa95-a00f88e39970] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:42.507374 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f3f68784-5a9a-4855-8e04-87f7b8fb4064 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:42.508314 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f3f68784-5a9a-4855-8e04-87f7b8fb4064 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:42.509830 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f3f68784-5a9a-4855-8e04-87f7b8fb4064 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:42.510740 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f3f68784-5a9a-4855-8e04-87f7b8fb4064 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:42.511344 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f3f68784-5a9a-4855-8e04-87f7b8fb4064 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:42.511943 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f3f68784-5a9a-4855-8e04-87f7b8fb4064 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:42.667199 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-f3f68784-5a9a-4855-8e04-87f7b8fb4064 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:42.675631 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-f3f68784-5a9a-4855-8e04-87f7b8fb4064 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970" status: 200 len: 1521 microversion: 2.1 time: 0.180259 Aug 10 11:34:42.676398 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 112/225] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:34:42 2022] GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:34:42.868339 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-b2531de6-b857-4d0d-bf15-b9a788daf92f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:42.868339 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-b2531de6-b857-4d0d-bf15-b9a788daf92f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:42.874298 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b2531de6-b857-4d0d-bf15-b9a788daf92f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:42.875139 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b2531de6-b857-4d0d-bf15-b9a788daf92f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:42.875777 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b2531de6-b857-4d0d-bf15-b9a788daf92f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:42.877009 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b2531de6-b857-4d0d-bf15-b9a788daf92f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:42.877704 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b2531de6-b857-4d0d-bf15-b9a788daf92f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:42.878356 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b2531de6-b857-4d0d-bf15-b9a788daf92f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:43.033971 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b2531de6-b857-4d0d-bf15-b9a788daf92f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:43.062702 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b2531de6-b857-4d0d-bf15-b9a788daf92f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:43.066001 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b2531de6-b857-4d0d-bf15-b9a788daf92f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:43.067502 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-b2531de6-b857-4d0d-bf15-b9a788daf92f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1723 microversion: 2.20 time: 0.206204 Aug 10 11:34:43.068363 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 113/226] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:34:42 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:34:43.481792 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-84812d0b-4107-4363-9073-ac932a6afbac tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "POST /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.108669 Aug 10 11:34:43.482615 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 114/227] 10.222.0.62 () {60 vars in 1323 bytes} [Wed Aug 10 11:34:42 2022] POST /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3/os-volume_attachments => generated 194 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:34:43.697725 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-ace5e786-4d48-4267-9ff4-6abe3b0755f7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:43.698415 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-ace5e786-4d48-4267-9ff4-6abe3b0755f7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 85d76c52-fcda-4805-aa95-a00f88e39970] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:43.700892 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=38 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:34:43.705511 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ace5e786-4d48-4267-9ff4-6abe3b0755f7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:43.706514 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ace5e786-4d48-4267-9ff4-6abe3b0755f7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:43.708187 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ace5e786-4d48-4267-9ff4-6abe3b0755f7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:43.710025 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ace5e786-4d48-4267-9ff4-6abe3b0755f7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:43.711413 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ace5e786-4d48-4267-9ff4-6abe3b0755f7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:43.713062 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ace5e786-4d48-4267-9ff4-6abe3b0755f7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:43.860832 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-ace5e786-4d48-4267-9ff4-6abe3b0755f7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:43.869661 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-ace5e786-4d48-4267-9ff4-6abe3b0755f7 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970" status: 200 len: 1521 microversion: 2.1 time: 0.175887 Aug 10 11:34:43.870246 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 114/228] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:34:43 2022] GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:34:44.099228 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-4f525bcb-d1f1-418a-8326-140f15be4c22 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:44.100112 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-4f525bcb-d1f1-418a-8326-140f15be4c22 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:44.114440 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4f525bcb-d1f1-418a-8326-140f15be4c22 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:44.115260 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4f525bcb-d1f1-418a-8326-140f15be4c22 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:44.115934 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4f525bcb-d1f1-418a-8326-140f15be4c22 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:44.116918 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4f525bcb-d1f1-418a-8326-140f15be4c22 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:44.117623 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4f525bcb-d1f1-418a-8326-140f15be4c22 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:44.118151 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4f525bcb-d1f1-418a-8326-140f15be4c22 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:44.306893 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-4f525bcb-d1f1-418a-8326-140f15be4c22 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:44.320736 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-4f525bcb-d1f1-418a-8326-140f15be4c22 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:44.322536 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-4f525bcb-d1f1-418a-8326-140f15be4c22 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:44.324073 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-4f525bcb-d1f1-418a-8326-140f15be4c22 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1723 microversion: 2.20 time: 0.230673 Aug 10 11:34:44.324640 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 115/229] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:34:44 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1723 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:34:44.891815 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-3827dd48-150f-4bda-b954-752224d2de80 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:44.892485 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-3827dd48-150f-4bda-b954-752224d2de80 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 85d76c52-fcda-4805-aa95-a00f88e39970] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:44.900025 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3827dd48-150f-4bda-b954-752224d2de80 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:44.900516 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3827dd48-150f-4bda-b954-752224d2de80 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:44.900959 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3827dd48-150f-4bda-b954-752224d2de80 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:44.901656 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3827dd48-150f-4bda-b954-752224d2de80 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:44.902116 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3827dd48-150f-4bda-b954-752224d2de80 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:44.902549 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3827dd48-150f-4bda-b954-752224d2de80 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:45.034154 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-3827dd48-150f-4bda-b954-752224d2de80 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:45.043069 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-3827dd48-150f-4bda-b954-752224d2de80 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970" status: 200 len: 1521 microversion: 2.1 time: 0.155297 Aug 10 11:34:45.043730 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 115/230] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:34:44 2022] GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:34:45.350567 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-cbc86e14-d9a2-4fe1-b635-3b0f98e3696d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:45.351247 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-cbc86e14-d9a2-4fe1-b635-3b0f98e3696d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:45.353605 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=34 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:34:45.358320 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cbc86e14-d9a2-4fe1-b635-3b0f98e3696d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:45.359564 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cbc86e14-d9a2-4fe1-b635-3b0f98e3696d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:45.359564 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cbc86e14-d9a2-4fe1-b635-3b0f98e3696d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:45.360118 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cbc86e14-d9a2-4fe1-b635-3b0f98e3696d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:45.360575 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cbc86e14-d9a2-4fe1-b635-3b0f98e3696d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:45.361003 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cbc86e14-d9a2-4fe1-b635-3b0f98e3696d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:45.494176 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-cbc86e14-d9a2-4fe1-b635-3b0f98e3696d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:45.503324 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-cbc86e14-d9a2-4fe1-b635-3b0f98e3696d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:45.505093 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-cbc86e14-d9a2-4fe1-b635-3b0f98e3696d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:45.506741 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-cbc86e14-d9a2-4fe1-b635-3b0f98e3696d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1723 microversion: 2.20 time: 0.160233 Aug 10 11:34:45.507221 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 116/231] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:34:45 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:34:46.063214 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-0c8575df-29dc-48a8-be53-890a0e85f0c9 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:46.063880 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-0c8575df-29dc-48a8-be53-890a0e85f0c9 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 85d76c52-fcda-4805-aa95-a00f88e39970] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:46.071500 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0c8575df-29dc-48a8-be53-890a0e85f0c9 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:46.072002 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0c8575df-29dc-48a8-be53-890a0e85f0c9 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:46.072441 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0c8575df-29dc-48a8-be53-890a0e85f0c9 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:46.073121 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0c8575df-29dc-48a8-be53-890a0e85f0c9 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:46.073574 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0c8575df-29dc-48a8-be53-890a0e85f0c9 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:46.074029 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0c8575df-29dc-48a8-be53-890a0e85f0c9 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:46.206223 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-0c8575df-29dc-48a8-be53-890a0e85f0c9 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:46.213615 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-0c8575df-29dc-48a8-be53-890a0e85f0c9 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970" status: 200 len: 1521 microversion: 2.1 time: 0.154268 Aug 10 11:34:46.214188 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 116/232] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:34:46 2022] GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:34:46.529416 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-74dd71ba-79eb-455d-8240-6735f2b56c19 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:46.530051 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-74dd71ba-79eb-455d-8240-6735f2b56c19 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:46.537352 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-74dd71ba-79eb-455d-8240-6735f2b56c19 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:46.537827 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-74dd71ba-79eb-455d-8240-6735f2b56c19 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:46.538256 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-74dd71ba-79eb-455d-8240-6735f2b56c19 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:46.538926 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-74dd71ba-79eb-455d-8240-6735f2b56c19 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:46.539501 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-74dd71ba-79eb-455d-8240-6735f2b56c19 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:46.539924 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-74dd71ba-79eb-455d-8240-6735f2b56c19 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:46.888240 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-74dd71ba-79eb-455d-8240-6735f2b56c19 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:46.896769 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-74dd71ba-79eb-455d-8240-6735f2b56c19 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:46.898256 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-74dd71ba-79eb-455d-8240-6735f2b56c19 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:46.899392 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-74dd71ba-79eb-455d-8240-6735f2b56c19 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1723 microversion: 2.20 time: 0.373875 Aug 10 11:34:46.899948 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 117/233] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:34:46 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1723 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:34:47.234498 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-ca525551-63a0-453b-821d-4020860afae5 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:47.235106 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-ca525551-63a0-453b-821d-4020860afae5 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 85d76c52-fcda-4805-aa95-a00f88e39970] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:47.242267 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ca525551-63a0-453b-821d-4020860afae5 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:47.242747 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ca525551-63a0-453b-821d-4020860afae5 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:47.243178 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ca525551-63a0-453b-821d-4020860afae5 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:47.243861 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ca525551-63a0-453b-821d-4020860afae5 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:47.244345 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ca525551-63a0-453b-821d-4020860afae5 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:47.244769 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ca525551-63a0-453b-821d-4020860afae5 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:47.374076 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-ca525551-63a0-453b-821d-4020860afae5 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:47.383200 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-ca525551-63a0-453b-821d-4020860afae5 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970" status: 200 len: 1521 microversion: 2.1 time: 0.152137 Aug 10 11:34:47.384005 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 117/234] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:34:47 2022] GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:34:47.922561 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-eec57bce-6f10-466c-b9b1-73887762bb22 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:47.923174 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-eec57bce-6f10-466c-b9b1-73887762bb22 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:47.929961 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-eec57bce-6f10-466c-b9b1-73887762bb22 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:47.930434 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-eec57bce-6f10-466c-b9b1-73887762bb22 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:47.930864 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-eec57bce-6f10-466c-b9b1-73887762bb22 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:47.931541 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-eec57bce-6f10-466c-b9b1-73887762bb22 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:47.932010 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-eec57bce-6f10-466c-b9b1-73887762bb22 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:47.932434 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-eec57bce-6f10-466c-b9b1-73887762bb22 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:47.947630 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:34:48.063171 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-eec57bce-6f10-466c-b9b1-73887762bb22 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:48.078390 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-eec57bce-6f10-466c-b9b1-73887762bb22 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:48.079893 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-eec57bce-6f10-466c-b9b1-73887762bb22 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:48.081146 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-eec57bce-6f10-466c-b9b1-73887762bb22 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1723 microversion: 2.20 time: 0.162386 Aug 10 11:34:48.081705 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 118/235] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:34:47 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:34:48.404769 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-67b68e63-7781-4067-aefc-ff5d37ed5cf4 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:48.406078 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-67b68e63-7781-4067-aefc-ff5d37ed5cf4 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 85d76c52-fcda-4805-aa95-a00f88e39970] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:48.413179 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-67b68e63-7781-4067-aefc-ff5d37ed5cf4 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:48.413669 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-67b68e63-7781-4067-aefc-ff5d37ed5cf4 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:48.414107 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-67b68e63-7781-4067-aefc-ff5d37ed5cf4 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:48.415578 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-67b68e63-7781-4067-aefc-ff5d37ed5cf4 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:48.416149 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-67b68e63-7781-4067-aefc-ff5d37ed5cf4 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:48.416584 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-67b68e63-7781-4067-aefc-ff5d37ed5cf4 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:48.579713 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-67b68e63-7781-4067-aefc-ff5d37ed5cf4 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:48.590012 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-67b68e63-7781-4067-aefc-ff5d37ed5cf4 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970" status: 200 len: 1521 microversion: 2.1 time: 0.189034 Aug 10 11:34:48.590709 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 118/236] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:34:48 2022] GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:34:49.103755 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-cbe06852-e5eb-49cd-8ba3-f371c8a551c3 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:49.104800 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-cbe06852-e5eb-49cd-8ba3-f371c8a551c3 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:49.111056 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cbe06852-e5eb-49cd-8ba3-f371c8a551c3 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:49.111540 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cbe06852-e5eb-49cd-8ba3-f371c8a551c3 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:49.112668 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cbe06852-e5eb-49cd-8ba3-f371c8a551c3 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:49.113332 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cbe06852-e5eb-49cd-8ba3-f371c8a551c3 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:49.113865 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cbe06852-e5eb-49cd-8ba3-f371c8a551c3 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:49.114290 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cbe06852-e5eb-49cd-8ba3-f371c8a551c3 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:49.244891 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-cbe06852-e5eb-49cd-8ba3-f371c8a551c3 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:49.254055 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-cbe06852-e5eb-49cd-8ba3-f371c8a551c3 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:49.255696 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-cbe06852-e5eb-49cd-8ba3-f371c8a551c3 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:49.257020 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-cbe06852-e5eb-49cd-8ba3-f371c8a551c3 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1723 microversion: 2.20 time: 0.157190 Aug 10 11:34:49.257652 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 119/237] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:34:49 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:34:49.611656 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-535313c7-2182-4cc6-8011-70579cb929f1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:49.612984 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-535313c7-2182-4cc6-8011-70579cb929f1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 85d76c52-fcda-4805-aa95-a00f88e39970] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:49.619750 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-535313c7-2182-4cc6-8011-70579cb929f1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:49.620278 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-535313c7-2182-4cc6-8011-70579cb929f1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:49.620729 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-535313c7-2182-4cc6-8011-70579cb929f1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:49.621433 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-535313c7-2182-4cc6-8011-70579cb929f1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:49.621890 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-535313c7-2182-4cc6-8011-70579cb929f1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:49.622325 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-535313c7-2182-4cc6-8011-70579cb929f1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:49.767317 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-535313c7-2182-4cc6-8011-70579cb929f1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:49.776060 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-535313c7-2182-4cc6-8011-70579cb929f1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970" status: 200 len: 1521 microversion: 2.1 time: 0.168149 Aug 10 11:34:49.781946 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 119/238] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:34:49 2022] GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:34:50.280663 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-277716bf-291a-4f20-bce9-218647bc6baa tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:50.281279 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-277716bf-291a-4f20-bce9-218647bc6baa tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:50.288179 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-277716bf-291a-4f20-bce9-218647bc6baa tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:50.288686 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-277716bf-291a-4f20-bce9-218647bc6baa tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:50.289104 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-277716bf-291a-4f20-bce9-218647bc6baa tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:50.289802 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-277716bf-291a-4f20-bce9-218647bc6baa tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:50.290404 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-277716bf-291a-4f20-bce9-218647bc6baa tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:50.290856 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-277716bf-291a-4f20-bce9-218647bc6baa tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:50.433373 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-277716bf-291a-4f20-bce9-218647bc6baa tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:50.442183 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-277716bf-291a-4f20-bce9-218647bc6baa tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:50.443864 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-277716bf-291a-4f20-bce9-218647bc6baa tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:50.445037 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-277716bf-291a-4f20-bce9-218647bc6baa tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1723 microversion: 2.20 time: 0.168545 Aug 10 11:34:50.445614 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 120/239] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:34:50 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:34:50.802832 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-9a9c745a-7f73-4265-9ba3-680582f01b25 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:50.803447 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-9a9c745a-7f73-4265-9ba3-680582f01b25 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 85d76c52-fcda-4805-aa95-a00f88e39970] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:50.810091 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9a9c745a-7f73-4265-9ba3-680582f01b25 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:50.810605 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9a9c745a-7f73-4265-9ba3-680582f01b25 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:50.811039 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9a9c745a-7f73-4265-9ba3-680582f01b25 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:50.811732 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9a9c745a-7f73-4265-9ba3-680582f01b25 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:50.812248 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9a9c745a-7f73-4265-9ba3-680582f01b25 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:50.812796 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9a9c745a-7f73-4265-9ba3-680582f01b25 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:50.830866 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=100 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:34:50.964863 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-9a9c745a-7f73-4265-9ba3-680582f01b25 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:50.973840 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-9a9c745a-7f73-4265-9ba3-680582f01b25 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970" status: 200 len: 1501 microversion: 2.1 time: 0.175567 Aug 10 11:34:50.974537 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 120/240] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:34:50 2022] GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970 => generated 1501 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:34:50.996146 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-4d227fab-6ef2-4446-aca8-4e1d6b916d40 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8746fde6-8b40-4da5-9f71-53f3c1579a23"}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:34:50.998999 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-4d227fab-6ef2-4446-aca8-4e1d6b916d40 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 85d76c52-fcda-4805-aa95-a00f88e39970] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:51.005864 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4d227fab-6ef2-4446-aca8-4e1d6b916d40 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:51.006381 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4d227fab-6ef2-4446-aca8-4e1d6b916d40 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:51.006843 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4d227fab-6ef2-4446-aca8-4e1d6b916d40 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:51.007565 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4d227fab-6ef2-4446-aca8-4e1d6b916d40 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:51.008037 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4d227fab-6ef2-4446-aca8-4e1d6b916d40 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:51.008618 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4d227fab-6ef2-4446-aca8-4e1d6b916d40 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:51.049138 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-4d227fab-6ef2-4446-aca8-4e1d6b916d40 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] HTTP exception thrown: Cannot 'attach_volume' instance 85d76c52-fcda-4805-aa95-a00f88e39970 while it is in vm_state rescued Aug 10 11:34:51.049138 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-4d227fab-6ef2-4446-aca8-4e1d6b916d40 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Request method failure captured: Aug 10 11:34:51.049138 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: request: POST /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970/os-volume_attachments HTTP/1.1 Aug 10 11:34:51.049138 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept: application/json Aug 10 11:34:51.049138 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Aug 10 11:34:51.049138 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Connection: close Aug 10 11:34:51.049138 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Length: 74 Aug 10 11:34:51.049138 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Type: application/json Aug 10 11:34:51.049138 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Host: 10.222.0.62 Aug 10 11:34:51.049138 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Aug 10 11:34:51.049138 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.11 Aug 10 11:34:51.049138 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABi85diKAHwXRzd2il03BjBn4GtPc8kISXNr_WlbPfAO6ScxlA2xKRFTXp6lv4Mx70H4OHfMxyACT9qtANdjRUlG0IXG7zsJ6Yh5tFE6PbxXVb6Pm5mIqh7eSEB9wtnuv9htvQ1QMN0TYW9yui41zYItyS58rcQtQxa6iH9KCT_lRB8CpA Aug 10 11:34:51.049138 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Aug 10 11:34:51.049138 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Aug 10 11:34:51.049138 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Aug 10 11:34:51.049138 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Aug 10 11:34:51.049138 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Aug 10 11:34:51.049138 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Aug 10 11:34:51.049138 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Id: a66fd06041084a16b8d5c5b9a9dbea52 Aug 10 11:34:51.049138 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-956924328 Aug 10 11:34:51.049138 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Role: member,reader Aug 10 11:34:51.049138 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Aug 10 11:34:51.051359 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/a66fd06041084a16b8d5c5b9a9dbea52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_a66fd06041084a16b8d5c5b9a9dbea52", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a66fd06041084a16b8d5c5b9a9dbea52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a66fd06041084a16b8d5c5b9a9dbea52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:34:51.051359 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-ServerRescueNegativeTestJSON-956924328 Aug 10 11:34:51.051359 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Id: a66fd06041084a16b8d5c5b9a9dbea52 Aug 10 11:34:51.051359 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-956924328 Aug 10 11:34:51.051359 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User: tempest-ServerRescueNegativeTestJSON-956924328-project Aug 10 11:34:51.051359 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Aug 10 11:34:51.051359 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Aug 10 11:34:51.051359 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Id: 81be34fdd1d741719b317b4fed21636d Aug 10 11:34:51.051359 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-ServerRescueNegativeTestJSON-956924328-project Aug 10 11:34:51.051359 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Aug 10 11:34:51.051359 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: {"volumeAttachment": {"volumeId": "8746fde6-8b40-4da5-9f71-53f3c1579a23"}} Aug 10 11:34:51.051359 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: method: > Aug 10 11:34:51.055218 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: exception: Cannot 'attach_volume' instance 85d76c52-fcda-4805-aa95-a00f88e39970 while it is in vm_state rescued Aug 10 11:34:51.055218 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: action_args: {'server_id': '85d76c52-fcda-4805-aa95-a00f88e39970', 'body': {'volumeAttachment': {'volumeId': '8746fde6-8b40-4da5-9f71-53f3c1579a23'}}} Aug 10 11:34:51.055218 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:34:51.055218 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:34:51.055218 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 10 11:34:51.055218 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 10 11:34:51.055218 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 11:34:51.055218 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 11:34:51.055218 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 10 11:34:51.055218 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 10 11:34:51.055218 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 85d76c52-fcda-4805-aa95-a00f88e39970 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 10 11:34:51.055218 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:34:51.055218 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:34:51.055218 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:34:51.055218 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:34:51.055218 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:34:51.055218 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:34:51.055218 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:34:51.055218 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:34:51.056776 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:34:51.056776 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:34:51.056776 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 11:34:51.056776 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 11:34:51.056776 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 11:34:51.056776 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 11:34:51.056776 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 11:34:51.056776 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 11:34:51.056776 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 10 11:34:51.056776 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 10 11:34:51.056776 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 10 11:34:51.056776 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 10 11:34:51.056776 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 85d76c52-fcda-4805-aa95-a00f88e39970 while it is in vm_state rescued Aug 10 11:34:51.056776 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:34:51.056776 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:34:51.056776 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:34:51.056776 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:34:51.056776 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:34:51.056776 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:34:51.057849 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:34:51.057849 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:34:51.057849 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 85d76c52-fcda-4805-aa95-a00f88e39970 while it is in vm_state rescued Aug 10 11:34:51.057849 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:34:51.057849 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-4d227fab-6ef2-4446-aca8-4e1d6b916d40 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Returning 409 to user: Cannot 'attach_volume' instance 85d76c52-fcda-4805-aa95-a00f88e39970 while it is in vm_state rescued {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:34:51.057849 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-4d227fab-6ef2-4446-aca8-4e1d6b916d40 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "POST /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.057335 Aug 10 11:34:51.057849 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 121/241] 10.222.0.62 () {60 vars in 1323 bytes} [Wed Aug 10 11:34:50 2022] POST /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970/os-volume_attachments => generated 152 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 10 11:34:51.059748 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-1c8260c1-1674-4770-a103-35fabe6f958d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:34:51.060330 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-1c8260c1-1674-4770-a103-35fabe6f958d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 85d76c52-fcda-4805-aa95-a00f88e39970] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:51.066967 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1c8260c1-1674-4770-a103-35fabe6f958d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:51.067468 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1c8260c1-1674-4770-a103-35fabe6f958d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:51.067994 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1c8260c1-1674-4770-a103-35fabe6f958d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:51.068724 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1c8260c1-1674-4770-a103-35fabe6f958d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:51.069188 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1c8260c1-1674-4770-a103-35fabe6f958d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:51.069616 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1c8260c1-1674-4770-a103-35fabe6f958d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:51.310065 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-1c8260c1-1674-4770-a103-35fabe6f958d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "POST /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970/action" status: 202 len: 0 microversion: 2.1 time: 0.254776 Aug 10 11:34:51.312197 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 121/242] 10.222.0.62 () {60 vars in 1278 bytes} [Wed Aug 10 11:34:51 2022] POST /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 11:34:51.319799 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-18a88360-95e0-4b02-84b4-a85ea15b65e3 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:51.320521 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-18a88360-95e0-4b02-84b4-a85ea15b65e3 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 85d76c52-fcda-4805-aa95-a00f88e39970] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:51.328034 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-18a88360-95e0-4b02-84b4-a85ea15b65e3 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:51.328594 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-18a88360-95e0-4b02-84b4-a85ea15b65e3 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:51.329225 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-18a88360-95e0-4b02-84b4-a85ea15b65e3 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:51.330501 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-18a88360-95e0-4b02-84b4-a85ea15b65e3 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:51.330975 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-18a88360-95e0-4b02-84b4-a85ea15b65e3 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:51.331409 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-18a88360-95e0-4b02-84b4-a85ea15b65e3 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:51.467751 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-483b3e85-4c4a-4dce-817a-55977010359a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:51.469153 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-483b3e85-4c4a-4dce-817a-55977010359a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:51.472464 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-18a88360-95e0-4b02-84b4-a85ea15b65e3 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:51.479844 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-483b3e85-4c4a-4dce-817a-55977010359a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:51.480399 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-483b3e85-4c4a-4dce-817a-55977010359a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:51.480843 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-483b3e85-4c4a-4dce-817a-55977010359a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:51.480954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-18a88360-95e0-4b02-84b4-a85ea15b65e3 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970" status: 200 len: 1509 microversion: 2.1 time: 0.165722 Aug 10 11:34:51.481445 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 122/243] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:34:51 2022] GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970 => generated 1509 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:34:51.492169 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-483b3e85-4c4a-4dce-817a-55977010359a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:51.492169 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-483b3e85-4c4a-4dce-817a-55977010359a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:51.492169 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-483b3e85-4c4a-4dce-817a-55977010359a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:51.705568 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-483b3e85-4c4a-4dce-817a-55977010359a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:51.713757 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-483b3e85-4c4a-4dce-817a-55977010359a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:51.715396 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-483b3e85-4c4a-4dce-817a-55977010359a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:51.716690 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-483b3e85-4c4a-4dce-817a-55977010359a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1723 microversion: 2.20 time: 0.253344 Aug 10 11:34:51.717330 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 122/244] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:34:51 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:34:52.173468 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-419092ee-29da-4fc0-8dba-730e286c5836 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:34:52.180180 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-419092ee-29da-4fc0-8dba-730e286c5836 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:52.180672 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-419092ee-29da-4fc0-8dba-730e286c5836 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:52.181295 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-419092ee-29da-4fc0-8dba-730e286c5836 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:52.242145 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-419092ee-29da-4fc0-8dba-730e286c5836 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Going to try to stop instance {{(pid=124683) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 10 11:34:52.395890 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-419092ee-29da-4fc0-8dba-730e286c5836 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "POST /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3/action" status: 202 len: 0 microversion: 2.1 time: 0.225444 Aug 10 11:34:52.396537 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 123/245] 10.222.0.62 () {60 vars in 1278 bytes} [Wed Aug 10 11:34:52 2022] POST /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:34:52.404587 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-54769cbe-0b5d-413b-ac16-e8d5bbb4d0f5 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:52.405234 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-54769cbe-0b5d-413b-ac16-e8d5bbb4d0f5 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:52.412971 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-54769cbe-0b5d-413b-ac16-e8d5bbb4d0f5 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:52.413461 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-54769cbe-0b5d-413b-ac16-e8d5bbb4d0f5 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:52.413897 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-54769cbe-0b5d-413b-ac16-e8d5bbb4d0f5 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:52.414601 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-54769cbe-0b5d-413b-ac16-e8d5bbb4d0f5 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:52.415054 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-54769cbe-0b5d-413b-ac16-e8d5bbb4d0f5 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:52.415482 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-54769cbe-0b5d-413b-ac16-e8d5bbb4d0f5 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:52.503692 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-7a6fb531-f8c3-4a60-8edc-0bf59a5f0a3b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:52.504515 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-7a6fb531-f8c3-4a60-8edc-0bf59a5f0a3b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 85d76c52-fcda-4805-aa95-a00f88e39970] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:52.510540 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7a6fb531-f8c3-4a60-8edc-0bf59a5f0a3b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:52.511020 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7a6fb531-f8c3-4a60-8edc-0bf59a5f0a3b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:52.511450 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7a6fb531-f8c3-4a60-8edc-0bf59a5f0a3b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:52.512164 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7a6fb531-f8c3-4a60-8edc-0bf59a5f0a3b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:52.512619 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7a6fb531-f8c3-4a60-8edc-0bf59a5f0a3b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:52.513038 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7a6fb531-f8c3-4a60-8edc-0bf59a5f0a3b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:52.554143 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-54769cbe-0b5d-413b-ac16-e8d5bbb4d0f5 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:52.562589 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-54769cbe-0b5d-413b-ac16-e8d5bbb4d0f5 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1723 microversion: 2.1 time: 0.161869 Aug 10 11:34:52.563356 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 123/246] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:34:52 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:34:52.670046 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-7a6fb531-f8c3-4a60-8edc-0bf59a5f0a3b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:52.678136 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-7a6fb531-f8c3-4a60-8edc-0bf59a5f0a3b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970" status: 200 len: 1509 microversion: 2.1 time: 0.178588 Aug 10 11:34:52.684625 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 124/247] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:34:52 2022] GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970 => generated 1509 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:34:52.741466 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-c8543f89-0d0a-47ae-b7d2-d2434e91beb7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:52.742076 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-c8543f89-0d0a-47ae-b7d2-d2434e91beb7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:52.748569 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c8543f89-0d0a-47ae-b7d2-d2434e91beb7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:52.749049 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c8543f89-0d0a-47ae-b7d2-d2434e91beb7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:52.749485 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c8543f89-0d0a-47ae-b7d2-d2434e91beb7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:52.750206 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c8543f89-0d0a-47ae-b7d2-d2434e91beb7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:52.750660 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c8543f89-0d0a-47ae-b7d2-d2434e91beb7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:52.751183 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c8543f89-0d0a-47ae-b7d2-d2434e91beb7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:52.899745 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c8543f89-0d0a-47ae-b7d2-d2434e91beb7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:52.908056 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c8543f89-0d0a-47ae-b7d2-d2434e91beb7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:52.909530 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c8543f89-0d0a-47ae-b7d2-d2434e91beb7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:52.911482 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-c8543f89-0d0a-47ae-b7d2-d2434e91beb7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1723 microversion: 2.20 time: 0.174437 Aug 10 11:34:52.912323 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 124/248] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:34:52 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:34:53.584610 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-6fc9aff7-d090-4659-bc6f-a5e8b78acca4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:53.585228 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-6fc9aff7-d090-4659-bc6f-a5e8b78acca4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:53.591809 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6fc9aff7-d090-4659-bc6f-a5e8b78acca4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:53.592327 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6fc9aff7-d090-4659-bc6f-a5e8b78acca4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:53.592765 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6fc9aff7-d090-4659-bc6f-a5e8b78acca4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:53.593497 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6fc9aff7-d090-4659-bc6f-a5e8b78acca4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:53.593974 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6fc9aff7-d090-4659-bc6f-a5e8b78acca4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:53.594401 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6fc9aff7-d090-4659-bc6f-a5e8b78acca4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:53.700376 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-bc6162bf-8e6e-42c3-82ac-dc7920f8f8e0 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:53.700909 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-bc6162bf-8e6e-42c3-82ac-dc7920f8f8e0 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 85d76c52-fcda-4805-aa95-a00f88e39970] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:53.708655 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bc6162bf-8e6e-42c3-82ac-dc7920f8f8e0 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:53.709271 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bc6162bf-8e6e-42c3-82ac-dc7920f8f8e0 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:53.709848 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bc6162bf-8e6e-42c3-82ac-dc7920f8f8e0 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:53.710694 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bc6162bf-8e6e-42c3-82ac-dc7920f8f8e0 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:53.713123 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bc6162bf-8e6e-42c3-82ac-dc7920f8f8e0 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:53.713570 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bc6162bf-8e6e-42c3-82ac-dc7920f8f8e0 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:53.738653 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-6fc9aff7-d090-4659-bc6f-a5e8b78acca4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:53.747414 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-6fc9aff7-d090-4659-bc6f-a5e8b78acca4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1723 microversion: 2.1 time: 0.167499 Aug 10 11:34:53.748099 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 125/249] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:34:53 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:34:53.855843 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-bc6162bf-8e6e-42c3-82ac-dc7920f8f8e0 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:53.863700 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-bc6162bf-8e6e-42c3-82ac-dc7920f8f8e0 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970" status: 200 len: 1509 microversion: 2.1 time: 0.167486 Aug 10 11:34:53.868265 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 125/250] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:34:53 2022] GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970 => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:34:53.936816 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-2879284f-9093-4aed-ad6a-dbfede422a5c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:53.937426 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-2879284f-9093-4aed-ad6a-dbfede422a5c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:53.944108 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2879284f-9093-4aed-ad6a-dbfede422a5c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:53.944594 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2879284f-9093-4aed-ad6a-dbfede422a5c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:53.945036 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2879284f-9093-4aed-ad6a-dbfede422a5c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:53.945733 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2879284f-9093-4aed-ad6a-dbfede422a5c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:53.946185 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2879284f-9093-4aed-ad6a-dbfede422a5c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:53.953323 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2879284f-9093-4aed-ad6a-dbfede422a5c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:54.093809 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-2879284f-9093-4aed-ad6a-dbfede422a5c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:54.102291 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-2879284f-9093-4aed-ad6a-dbfede422a5c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:54.103870 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-2879284f-9093-4aed-ad6a-dbfede422a5c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:54.105239 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-2879284f-9093-4aed-ad6a-dbfede422a5c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1723 microversion: 2.20 time: 0.172154 Aug 10 11:34:54.105984 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 126/251] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:34:53 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:34:54.773950 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-e3f4af33-e71a-4257-a1e1-0c487baa7fd4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:54.774639 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-e3f4af33-e71a-4257-a1e1-0c487baa7fd4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:54.781308 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e3f4af33-e71a-4257-a1e1-0c487baa7fd4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:54.781789 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e3f4af33-e71a-4257-a1e1-0c487baa7fd4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:54.782219 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e3f4af33-e71a-4257-a1e1-0c487baa7fd4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:54.782910 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e3f4af33-e71a-4257-a1e1-0c487baa7fd4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:54.783412 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e3f4af33-e71a-4257-a1e1-0c487baa7fd4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:54.783834 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e3f4af33-e71a-4257-a1e1-0c487baa7fd4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:54.905599 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-c385ac88-82ac-4b0b-bfb2-a290507bd4ba tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:54.905599 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-c385ac88-82ac-4b0b-bfb2-a290507bd4ba tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 85d76c52-fcda-4805-aa95-a00f88e39970] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:54.923157 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c385ac88-82ac-4b0b-bfb2-a290507bd4ba tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:54.923756 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c385ac88-82ac-4b0b-bfb2-a290507bd4ba tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:54.924346 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c385ac88-82ac-4b0b-bfb2-a290507bd4ba tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:54.925101 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c385ac88-82ac-4b0b-bfb2-a290507bd4ba tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:54.925590 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c385ac88-82ac-4b0b-bfb2-a290507bd4ba tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:54.926121 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c385ac88-82ac-4b0b-bfb2-a290507bd4ba tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:54.927706 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-e3f4af33-e71a-4257-a1e1-0c487baa7fd4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:54.946104 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-e3f4af33-e71a-4257-a1e1-0c487baa7fd4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1723 microversion: 2.1 time: 0.176122 Aug 10 11:34:54.946961 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 126/252] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:34:54 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:34:55.133143 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-e9ea0924-5489-4540-a11f-dc4d2fed6339 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:55.133143 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-e9ea0924-5489-4540-a11f-dc4d2fed6339 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:55.137777 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e9ea0924-5489-4540-a11f-dc4d2fed6339 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:55.138288 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e9ea0924-5489-4540-a11f-dc4d2fed6339 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:55.139156 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e9ea0924-5489-4540-a11f-dc4d2fed6339 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:55.140408 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e9ea0924-5489-4540-a11f-dc4d2fed6339 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:55.141025 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e9ea0924-5489-4540-a11f-dc4d2fed6339 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:55.141457 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e9ea0924-5489-4540-a11f-dc4d2fed6339 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:55.187145 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-c385ac88-82ac-4b0b-bfb2-a290507bd4ba tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:55.199396 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-c385ac88-82ac-4b0b-bfb2-a290507bd4ba tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970" status: 200 len: 1515 microversion: 2.1 time: 0.316853 Aug 10 11:34:55.220741 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 127/253] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:34:54 2022] GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970 => generated 1515 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:34:55.426236 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-e9ea0924-5489-4540-a11f-dc4d2fed6339 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:55.434874 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-e9ea0924-5489-4540-a11f-dc4d2fed6339 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:55.436626 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-e9ea0924-5489-4540-a11f-dc4d2fed6339 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:55.437808 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-e9ea0924-5489-4540-a11f-dc4d2fed6339 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1744 microversion: 2.20 time: 0.312509 Aug 10 11:34:55.438375 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 127/254] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:34:55 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1744 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:34:55.976612 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-71ea3e87-59c5-4a7e-ba0a-226c3c6a62bb tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:55.976612 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-71ea3e87-59c5-4a7e-ba0a-226c3c6a62bb tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:55.981833 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-71ea3e87-59c5-4a7e-ba0a-226c3c6a62bb tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:55.982319 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-71ea3e87-59c5-4a7e-ba0a-226c3c6a62bb tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:55.982863 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-71ea3e87-59c5-4a7e-ba0a-226c3c6a62bb tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:55.983550 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-71ea3e87-59c5-4a7e-ba0a-226c3c6a62bb tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:55.984026 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-71ea3e87-59c5-4a7e-ba0a-226c3c6a62bb tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:55.984572 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-71ea3e87-59c5-4a7e-ba0a-226c3c6a62bb tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:56.320367 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-71ea3e87-59c5-4a7e-ba0a-226c3c6a62bb tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:56.332000 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-71ea3e87-59c5-4a7e-ba0a-226c3c6a62bb tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1723 microversion: 2.1 time: 0.362093 Aug 10 11:34:56.333153 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 128/255] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:34:55 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1723 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:34:56.463144 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-889b52d0-b09f-486f-9b16-5ba72e02e4ee tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:56.463144 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-889b52d0-b09f-486f-9b16-5ba72e02e4ee tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:56.469201 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-889b52d0-b09f-486f-9b16-5ba72e02e4ee tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:56.469633 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-889b52d0-b09f-486f-9b16-5ba72e02e4ee tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:56.470192 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-889b52d0-b09f-486f-9b16-5ba72e02e4ee tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:56.470832 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-889b52d0-b09f-486f-9b16-5ba72e02e4ee tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:56.471278 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-889b52d0-b09f-486f-9b16-5ba72e02e4ee tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:56.471698 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-889b52d0-b09f-486f-9b16-5ba72e02e4ee tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:56.685690 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-889b52d0-b09f-486f-9b16-5ba72e02e4ee tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:56.704780 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-889b52d0-b09f-486f-9b16-5ba72e02e4ee tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:56.706881 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-889b52d0-b09f-486f-9b16-5ba72e02e4ee tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:56.710664 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-889b52d0-b09f-486f-9b16-5ba72e02e4ee tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1744 microversion: 2.20 time: 0.252713 Aug 10 11:34:56.711918 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 128/256] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:34:56 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1744 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:34:56.880237 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-5776d7d4-427a-4e27-9447-2e9a900c402a tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Action: 'create', calling method: .version_select at 0x7fb7ce0f7ee0>, body: {"keypair": {"name": "tempest-keypair-991532839", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKh/cTBgQvhP3IlDF/mrmuwwK+Ey0UUKd3fA5lkNT66qZPwjj7lUDCzgcmoWLYFgMg1QUcmPKq/ZdLAqUIDMO5b2fUDxiBRX3sM6/E/Al8tc5HRyKNwqzlSeEGR6kML6lg=="}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:34:56.900995 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-5776d7d4-427a-4e27-9447-2e9a900c402a tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Getting quotas for project a66fd06041084a16b8d5c5b9a9dbea52. Resources: {'key_pairs'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:34:56.905027 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-5776d7d4-427a-4e27-9447-2e9a900c402a tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Getting quotas for user 81be34fdd1d741719b317b4fed21636d and project a66fd06041084a16b8d5c5b9a9dbea52. Resources: {'key_pairs'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:34:57.004899 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-5776d7d4-427a-4e27-9447-2e9a900c402a tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.130366 Aug 10 11:34:57.005590 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 129/257] 10.222.0.62 () {60 vars in 1159 bytes} [Wed Aug 10 11:34:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:34:57.354503 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-dc56e4ed-7d59-401f-ad1d-96a584cde555 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:57.355120 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-dc56e4ed-7d59-401f-ad1d-96a584cde555 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:57.364157 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-dc56e4ed-7d59-401f-ad1d-96a584cde555 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:57.364979 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-dc56e4ed-7d59-401f-ad1d-96a584cde555 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:57.366028 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-dc56e4ed-7d59-401f-ad1d-96a584cde555 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:57.366946 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-dc56e4ed-7d59-401f-ad1d-96a584cde555 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:57.367577 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-dc56e4ed-7d59-401f-ad1d-96a584cde555 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:57.368206 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-dc56e4ed-7d59-401f-ad1d-96a584cde555 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:57.528853 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-dc56e4ed-7d59-401f-ad1d-96a584cde555 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:57.538073 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-dc56e4ed-7d59-401f-ad1d-96a584cde555 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1723 microversion: 2.1 time: 0.187647 Aug 10 11:34:57.538901 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 129/258] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:34:57 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:34:57.735383 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-709d65d3-dd2e-4f4d-b2a3-e7fe4f4e8f27 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:57.747148 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-709d65d3-dd2e-4f4d-b2a3-e7fe4f4e8f27 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:57.747148 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-709d65d3-dd2e-4f4d-b2a3-e7fe4f4e8f27 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:57.747148 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-709d65d3-dd2e-4f4d-b2a3-e7fe4f4e8f27 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:57.747148 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-709d65d3-dd2e-4f4d-b2a3-e7fe4f4e8f27 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:57.747695 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-709d65d3-dd2e-4f4d-b2a3-e7fe4f4e8f27 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:57.747695 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-709d65d3-dd2e-4f4d-b2a3-e7fe4f4e8f27 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:57.747695 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-709d65d3-dd2e-4f4d-b2a3-e7fe4f4e8f27 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:57.942610 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-709d65d3-dd2e-4f4d-b2a3-e7fe4f4e8f27 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:57.951954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-709d65d3-dd2e-4f4d-b2a3-e7fe4f4e8f27 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:57.953753 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-709d65d3-dd2e-4f4d-b2a3-e7fe4f4e8f27 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:57.955119 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-709d65d3-dd2e-4f4d-b2a3-e7fe4f4e8f27 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1744 microversion: 2.20 time: 0.224722 Aug 10 11:34:57.955682 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 130/259] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:34:57 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1744 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:34:58.564172 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-29321602-2357-4100-b15a-0e426f7ef883 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:58.564172 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-29321602-2357-4100-b15a-0e426f7ef883 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:58.573169 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-29321602-2357-4100-b15a-0e426f7ef883 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:58.573665 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-29321602-2357-4100-b15a-0e426f7ef883 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:58.574110 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-29321602-2357-4100-b15a-0e426f7ef883 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:58.574811 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-29321602-2357-4100-b15a-0e426f7ef883 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:58.579604 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-29321602-2357-4100-b15a-0e426f7ef883 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:58.580093 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-29321602-2357-4100-b15a-0e426f7ef883 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:58.788216 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-29321602-2357-4100-b15a-0e426f7ef883 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:58.802034 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-29321602-2357-4100-b15a-0e426f7ef883 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1723 microversion: 2.1 time: 0.239666 Aug 10 11:34:58.802034 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 130/260] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:34:58 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1723 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:34:58.953792 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-34e32d43-b351-4154-99af-1210f22d3524 req-49b28d86-f47f-4f48-aa06-a8efff9e58a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e6ed242-956f-4b14-8520-18920447bf05", "name": "network-vif-plugged", "status": "completed", "tag": "f3f3926f-a2b3-40b5-a25f-a37b15cc0401"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:34:58.966761 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-34e32d43-b351-4154-99af-1210f22d3524 req-49b28d86-f47f-4f48-aa06-a8efff9e58a0 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:58.967323 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-34e32d43-b351-4154-99af-1210f22d3524 req-49b28d86-f47f-4f48-aa06-a8efff9e58a0 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:58.967952 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-34e32d43-b351-4154-99af-1210f22d3524 req-49b28d86-f47f-4f48-aa06-a8efff9e58a0 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:58.989078 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-4e090edc-7607-4da4-bf79-5048ee0be595 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:58.989078 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-4e090edc-7607-4da4-bf79-5048ee0be595 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:58.989078 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4e090edc-7607-4da4-bf79-5048ee0be595 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:58.989078 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4e090edc-7607-4da4-bf79-5048ee0be595 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:58.989850 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4e090edc-7607-4da4-bf79-5048ee0be595 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:58.990392 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4e090edc-7607-4da4-bf79-5048ee0be595 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:58.991065 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4e090edc-7607-4da4-bf79-5048ee0be595 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:58.991173 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-34e32d43-b351-4154-99af-1210f22d3524 req-49b28d86-f47f-4f48-aa06-a8efff9e58a0 service nova] Creating event network-vif-plugged:f3f3926f-a2b3-40b5-a25f-a37b15cc0401 for instance 9e6ed242-956f-4b14-8520-18920447bf05 on hv-cinder-85272 Aug 10 11:34:58.991793 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4e090edc-7607-4da4-bf79-5048ee0be595 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:58.996815 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-34e32d43-b351-4154-99af-1210f22d3524 req-49b28d86-f47f-4f48-aa06-a8efff9e58a0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056094 Aug 10 11:34:59.001621 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 131/261] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:34:59.203936 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-4e090edc-7607-4da4-bf79-5048ee0be595 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:59.218257 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-4e090edc-7607-4da4-bf79-5048ee0be595 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:59.219925 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-4e090edc-7607-4da4-bf79-5048ee0be595 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:59.221601 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-4e090edc-7607-4da4-bf79-5048ee0be595 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1739 microversion: 2.20 time: 0.245157 Aug 10 11:34:59.222097 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 131/262] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:34:58 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1739 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:34:59.721848 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-46a23550-e0b2-4904-856f-bd0ecb17c2cf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-354923175", "imageRef": "99bbc441-5102-4a51-a496-cfbffeb3033a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "33de9024-0342-43c4-b011-697e74d98369"}], "security_groups": [{"name": "tempest-securitygroup--935441565"}], "key_name": "tempest-keypair-991532839", "user_data": "}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:34:59.819685 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-1d207f90-7572-40cd-9b48-4fdcb58809e3 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:59.820265 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-1d207f90-7572-40cd-9b48-4fdcb58809e3 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:59.830426 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1d207f90-7572-40cd-9b48-4fdcb58809e3 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:59.830923 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1d207f90-7572-40cd-9b48-4fdcb58809e3 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:59.836127 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1d207f90-7572-40cd-9b48-4fdcb58809e3 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:59.836127 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1d207f90-7572-40cd-9b48-4fdcb58809e3 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:59.836127 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1d207f90-7572-40cd-9b48-4fdcb58809e3 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:59.836127 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1d207f90-7572-40cd-9b48-4fdcb58809e3 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:00.026707 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-1d207f90-7572-40cd-9b48-4fdcb58809e3 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:00.051076 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-1d207f90-7572-40cd-9b48-4fdcb58809e3 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1723 microversion: 2.1 time: 0.236306 Aug 10 11:35:00.053523 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 132/263] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:34:59 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:35:00.208238 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.network.neutron [None req-46a23550-e0b2-4904-856f-bd0ecb17c2cf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] validate_networks() for [('33de9024-0342-43c4-b011-697e74d98369', None, None, None, None, None)] {{(pid=124683) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:35:00.246880 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-5479139f-6fe5-4f30-828a-5c6f75a879a4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:00.247828 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-5479139f-6fe5-4f30-828a-5c6f75a879a4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:00.255495 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5479139f-6fe5-4f30-828a-5c6f75a879a4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:00.256507 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5479139f-6fe5-4f30-828a-5c6f75a879a4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:00.258753 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5479139f-6fe5-4f30-828a-5c6f75a879a4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:00.258753 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5479139f-6fe5-4f30-828a-5c6f75a879a4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:00.258753 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5479139f-6fe5-4f30-828a-5c6f75a879a4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:00.259364 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5479139f-6fe5-4f30-828a-5c6f75a879a4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:00.433892 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-5479139f-6fe5-4f30-828a-5c6f75a879a4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:00.444714 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-5479139f-6fe5-4f30-828a-5c6f75a879a4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:00.448119 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-5479139f-6fe5-4f30-828a-5c6f75a879a4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:00.448119 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-5479139f-6fe5-4f30-828a-5c6f75a879a4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1739 microversion: 2.20 time: 0.205962 Aug 10 11:35:00.450627 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 133/264] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:35:00 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1739 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:35:00.837745 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-46a23550-e0b2-4904-856f-bd0ecb17c2cf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Flavor limits 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:35:00.838368 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-46a23550-e0b2-4904-856f-bd0ecb17c2cf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Image limits 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:35:00.839059 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-46a23550-e0b2-4904-856f-bd0ecb17c2cf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Flavor pref 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:35:00.839635 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-46a23550-e0b2-4904-856f-bd0ecb17c2cf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Image pref 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:35:00.840366 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-46a23550-e0b2-4904-856f-bd0ecb17c2cf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:35:00.861898 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-46a23550-e0b2-4904-856f-bd0ecb17c2cf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:00.863019 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-46a23550-e0b2-4904-856f-bd0ecb17c2cf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:00.866173 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-46a23550-e0b2-4904-856f-bd0ecb17c2cf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:00.868200 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-46a23550-e0b2-4904-856f-bd0ecb17c2cf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:00.871610 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-46a23550-e0b2-4904-856f-bd0ecb17c2cf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:00.874448 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-46a23550-e0b2-4904-856f-bd0ecb17c2cf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:00.922086 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-46a23550-e0b2-4904-856f-bd0ecb17c2cf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Getting quotas for project a66fd06041084a16b8d5c5b9a9dbea52. Resources: {'ram', 'instances', 'cores'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:35:00.930472 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-46a23550-e0b2-4904-856f-bd0ecb17c2cf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Getting quotas for user 81be34fdd1d741719b317b4fed21636d and project a66fd06041084a16b8d5c5b9a9dbea52. Resources: {'ram', 'instances', 'cores'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:35:00.955440 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-46a23550-e0b2-4904-856f-bd0ecb17c2cf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Going to run 1 instances... {{(pid=124683) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:35:00.960300 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-46a23550-e0b2-4904-856f-bd0ecb17c2cf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99bbc441-5102-4a51-a496-cfbffeb3033a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124683) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:35:01.084382 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-73214f6b-638e-477f-bd99-b0bff0b2cb41 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:01.085725 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-73214f6b-638e-477f-bd99-b0bff0b2cb41 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:01.095505 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-46a23550-e0b2-4904-856f-bd0ecb17c2cf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.378239 Aug 10 11:35:01.099185 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 132/265] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Aug 10 11:34:59 2022] POST /compute/v2.1/servers => generated 408 bytes in 1383 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 11:35:01.102088 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-73214f6b-638e-477f-bd99-b0bff0b2cb41 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:01.104988 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-73214f6b-638e-477f-bd99-b0bff0b2cb41 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:01.107515 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-73214f6b-638e-477f-bd99-b0bff0b2cb41 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:01.110240 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-052767ed-e906-4733-95a3-22fe90e3f759 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:01.110633 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-73214f6b-638e-477f-bd99-b0bff0b2cb41 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:01.112378 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-73214f6b-638e-477f-bd99-b0bff0b2cb41 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:01.114370 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-73214f6b-638e-477f-bd99-b0bff0b2cb41 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:01.114925 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-052767ed-e906-4733-95a3-22fe90e3f759 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:01.223410 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-052767ed-e906-4733-95a3-22fe90e3f759 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:01.232773 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-052767ed-e906-4733-95a3-22fe90e3f759 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5" status: 200 len: 1244 microversion: 2.1 time: 0.125603 Aug 10 11:35:01.245664 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 133/266] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:01 2022] GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5 => generated 1244 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:01.477342 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-251dc9bd-1c23-4b8b-adc8-aeb38a208655 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:01.479001 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-251dc9bd-1c23-4b8b-adc8-aeb38a208655 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:01.487994 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-251dc9bd-1c23-4b8b-adc8-aeb38a208655 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:01.490414 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-251dc9bd-1c23-4b8b-adc8-aeb38a208655 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:01.491093 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-251dc9bd-1c23-4b8b-adc8-aeb38a208655 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:01.492996 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-251dc9bd-1c23-4b8b-adc8-aeb38a208655 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:01.494056 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-73214f6b-638e-477f-bd99-b0bff0b2cb41 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:01.494657 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-251dc9bd-1c23-4b8b-adc8-aeb38a208655 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:01.495908 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-251dc9bd-1c23-4b8b-adc8-aeb38a208655 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:01.511098 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-73214f6b-638e-477f-bd99-b0bff0b2cb41 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1723 microversion: 2.1 time: 0.437908 Aug 10 11:35:01.511740 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 134/267] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:01 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1723 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:01.694493 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-251dc9bd-1c23-4b8b-adc8-aeb38a208655 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:01.703516 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-251dc9bd-1c23-4b8b-adc8-aeb38a208655 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:01.705357 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-251dc9bd-1c23-4b8b-adc8-aeb38a208655 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:01.706851 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-251dc9bd-1c23-4b8b-adc8-aeb38a208655 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1739 microversion: 2.20 time: 0.236229 Aug 10 11:35:01.707406 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 134/268] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:35:01 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1739 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:35:02.259338 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-f2287fa7-5273-4e5c-af9e-11537abeed6e tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:02.260678 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-f2287fa7-5273-4e5c-af9e-11537abeed6e tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:02.320578 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-f2287fa7-5273-4e5c-af9e-11537abeed6e tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:02.327338 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-f2287fa7-5273-4e5c-af9e-11537abeed6e tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5" status: 200 len: 1244 microversion: 2.1 time: 0.071994 Aug 10 11:35:02.328125 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 135/269] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:02 2022] GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5 => generated 1244 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:02.533221 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-194a4f38-cdba-4213-bf17-2d0a8d097c8e tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:02.534686 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-194a4f38-cdba-4213-bf17-2d0a8d097c8e tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:02.545310 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-194a4f38-cdba-4213-bf17-2d0a8d097c8e tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:02.546371 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-194a4f38-cdba-4213-bf17-2d0a8d097c8e tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:02.547035 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-194a4f38-cdba-4213-bf17-2d0a8d097c8e tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:02.547914 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-194a4f38-cdba-4213-bf17-2d0a8d097c8e tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:02.548540 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-194a4f38-cdba-4213-bf17-2d0a8d097c8e tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:02.549392 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-194a4f38-cdba-4213-bf17-2d0a8d097c8e tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:02.731630 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-ab99a3dd-a180-4e62-b45d-0c9ccc452f24 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:02.733429 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-ab99a3dd-a180-4e62-b45d-0c9ccc452f24 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:02.741427 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ab99a3dd-a180-4e62-b45d-0c9ccc452f24 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:02.747015 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ab99a3dd-a180-4e62-b45d-0c9ccc452f24 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:02.749838 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ab99a3dd-a180-4e62-b45d-0c9ccc452f24 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:02.749838 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ab99a3dd-a180-4e62-b45d-0c9ccc452f24 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:02.749838 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ab99a3dd-a180-4e62-b45d-0c9ccc452f24 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:02.749838 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ab99a3dd-a180-4e62-b45d-0c9ccc452f24 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:02.768797 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-194a4f38-cdba-4213-bf17-2d0a8d097c8e tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:02.779907 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-194a4f38-cdba-4213-bf17-2d0a8d097c8e tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1723 microversion: 2.1 time: 0.250718 Aug 10 11:35:02.807031 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 135/270] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:02 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1723 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:02.970463 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-ab99a3dd-a180-4e62-b45d-0c9ccc452f24 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:02.979391 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-ab99a3dd-a180-4e62-b45d-0c9ccc452f24 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:02.980901 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-ab99a3dd-a180-4e62-b45d-0c9ccc452f24 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:02.983754 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-ab99a3dd-a180-4e62-b45d-0c9ccc452f24 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1739 microversion: 2.20 time: 0.257047 Aug 10 11:35:03.001275 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 136/271] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:35:02 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1739 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:35:03.355915 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-8cde2ac7-c1ec-4dc8-b4c0-cdca1304b376 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:03.356206 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-8cde2ac7-c1ec-4dc8-b4c0-cdca1304b376 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:03.362316 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8cde2ac7-c1ec-4dc8-b4c0-cdca1304b376 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:03.368768 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8cde2ac7-c1ec-4dc8-b4c0-cdca1304b376 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:03.368768 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8cde2ac7-c1ec-4dc8-b4c0-cdca1304b376 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:03.368768 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8cde2ac7-c1ec-4dc8-b4c0-cdca1304b376 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:03.368768 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8cde2ac7-c1ec-4dc8-b4c0-cdca1304b376 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:03.370030 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8cde2ac7-c1ec-4dc8-b4c0-cdca1304b376 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:03.428972 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-8cde2ac7-c1ec-4dc8-b4c0-cdca1304b376 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:03.436422 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-8cde2ac7-c1ec-4dc8-b4c0-cdca1304b376 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5" status: 200 len: 1248 microversion: 2.1 time: 0.085304 Aug 10 11:35:03.436985 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 136/272] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:03 2022] GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5 => generated 1248 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:35:03.818499 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-01dc9709-0e11-48c2-9f3e-47de29bddb98 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:03.819733 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-01dc9709-0e11-48c2-9f3e-47de29bddb98 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:03.831313 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-01dc9709-0e11-48c2-9f3e-47de29bddb98 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:03.833833 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-01dc9709-0e11-48c2-9f3e-47de29bddb98 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:03.835275 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-01dc9709-0e11-48c2-9f3e-47de29bddb98 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:03.837186 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-01dc9709-0e11-48c2-9f3e-47de29bddb98 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:03.837796 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-01dc9709-0e11-48c2-9f3e-47de29bddb98 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:03.839050 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-01dc9709-0e11-48c2-9f3e-47de29bddb98 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:03.851535 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:35:04.007276 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-5ace98a5-72f8-409b-a8da-041de4a68459 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:04.008763 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-5ace98a5-72f8-409b-a8da-041de4a68459 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:04.026233 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5ace98a5-72f8-409b-a8da-041de4a68459 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:04.029136 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5ace98a5-72f8-409b-a8da-041de4a68459 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:04.029521 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5ace98a5-72f8-409b-a8da-041de4a68459 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:04.033060 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5ace98a5-72f8-409b-a8da-041de4a68459 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:04.033692 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5ace98a5-72f8-409b-a8da-041de4a68459 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:04.034301 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5ace98a5-72f8-409b-a8da-041de4a68459 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:04.081478 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-01dc9709-0e11-48c2-9f3e-47de29bddb98 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:04.093361 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-01dc9709-0e11-48c2-9f3e-47de29bddb98 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1723 microversion: 2.1 time: 0.280607 Aug 10 11:35:04.093983 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 137/273] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:03 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1723 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:04.279289 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-5ace98a5-72f8-409b-a8da-041de4a68459 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:04.282138 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:35:04.290242 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-5ace98a5-72f8-409b-a8da-041de4a68459 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:04.292108 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-5ace98a5-72f8-409b-a8da-041de4a68459 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:04.293988 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-5ace98a5-72f8-409b-a8da-041de4a68459 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1739 microversion: 2.20 time: 0.291788 Aug 10 11:35:04.294847 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 137/274] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:35:04 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1739 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:35:04.460527 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-c1eeb862-95a9-4007-941a-d218eb0770d5 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:04.463449 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-c1eeb862-95a9-4007-941a-d218eb0770d5 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:04.467688 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c1eeb862-95a9-4007-941a-d218eb0770d5 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:04.468225 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c1eeb862-95a9-4007-941a-d218eb0770d5 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:04.468737 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c1eeb862-95a9-4007-941a-d218eb0770d5 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:04.469519 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c1eeb862-95a9-4007-941a-d218eb0770d5 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:04.470042 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c1eeb862-95a9-4007-941a-d218eb0770d5 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:04.470472 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c1eeb862-95a9-4007-941a-d218eb0770d5 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:04.584666 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c1eeb862-95a9-4007-941a-d218eb0770d5 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:04.598526 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-c1eeb862-95a9-4007-941a-d218eb0770d5 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5" status: 200 len: 1296 microversion: 2.1 time: 0.144436 Aug 10 11:35:04.610511 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 138/275] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:04 2022] GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5 => generated 1296 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:05.115722 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f857e536-5311-4c99-9874-1024b4c8f06e tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:05.116461 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-f857e536-5311-4c99-9874-1024b4c8f06e tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:05.125866 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f857e536-5311-4c99-9874-1024b4c8f06e tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:05.132056 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f857e536-5311-4c99-9874-1024b4c8f06e tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:05.132056 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f857e536-5311-4c99-9874-1024b4c8f06e tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:05.132056 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f857e536-5311-4c99-9874-1024b4c8f06e tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:05.132056 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f857e536-5311-4c99-9874-1024b4c8f06e tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:05.132484 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f857e536-5311-4c99-9874-1024b4c8f06e tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:05.317597 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-69e7cb5f-4487-49b8-920a-a49252c88b8e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:05.318447 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-69e7cb5f-4487-49b8-920a-a49252c88b8e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:05.329901 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-69e7cb5f-4487-49b8-920a-a49252c88b8e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:05.332402 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-69e7cb5f-4487-49b8-920a-a49252c88b8e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:05.332402 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-69e7cb5f-4487-49b8-920a-a49252c88b8e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:05.332402 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-69e7cb5f-4487-49b8-920a-a49252c88b8e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:05.335179 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-69e7cb5f-4487-49b8-920a-a49252c88b8e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:05.335696 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-69e7cb5f-4487-49b8-920a-a49252c88b8e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:05.349241 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-f857e536-5311-4c99-9874-1024b4c8f06e tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:05.361017 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-f857e536-5311-4c99-9874-1024b4c8f06e tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1723 microversion: 2.1 time: 0.246707 Aug 10 11:35:05.372147 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 138/276] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:05 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1723 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:05.590221 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-69e7cb5f-4487-49b8-920a-a49252c88b8e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:05.599934 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-69e7cb5f-4487-49b8-920a-a49252c88b8e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:05.601791 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-69e7cb5f-4487-49b8-920a-a49252c88b8e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:05.603162 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-69e7cb5f-4487-49b8-920a-a49252c88b8e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1739 microversion: 2.20 time: 0.290316 Aug 10 11:35:05.616631 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 139/277] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:35:05 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1739 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:35:05.624460 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f4ea2871-c06e-4e85-b986-746083abdb2f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:05.625293 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-f4ea2871-c06e-4e85-b986-746083abdb2f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:05.632666 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f4ea2871-c06e-4e85-b986-746083abdb2f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:05.633392 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f4ea2871-c06e-4e85-b986-746083abdb2f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:05.634032 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f4ea2871-c06e-4e85-b986-746083abdb2f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:05.634740 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f4ea2871-c06e-4e85-b986-746083abdb2f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:05.635203 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f4ea2871-c06e-4e85-b986-746083abdb2f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:05.635633 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f4ea2871-c06e-4e85-b986-746083abdb2f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:05.707123 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-f4ea2871-c06e-4e85-b986-746083abdb2f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:05.718746 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-f4ea2871-c06e-4e85-b986-746083abdb2f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5" status: 200 len: 1302 microversion: 2.1 time: 0.098181 Aug 10 11:35:05.728370 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 139/278] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:05 2022] GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5 => generated 1302 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:06.380545 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-8abf6ba4-ef22-48bf-8507-f3388f408909 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:06.381182 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-8abf6ba4-ef22-48bf-8507-f3388f408909 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:06.403229 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8abf6ba4-ef22-48bf-8507-f3388f408909 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:06.403229 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8abf6ba4-ef22-48bf-8507-f3388f408909 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:06.415339 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8abf6ba4-ef22-48bf-8507-f3388f408909 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:06.418113 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8abf6ba4-ef22-48bf-8507-f3388f408909 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:06.418624 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8abf6ba4-ef22-48bf-8507-f3388f408909 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:06.419075 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8abf6ba4-ef22-48bf-8507-f3388f408909 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:06.634499 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-e7081f29-9680-4bff-a6f6-f89b7a728b2e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:06.635932 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-e7081f29-9680-4bff-a6f6-f89b7a728b2e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:06.654381 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e7081f29-9680-4bff-a6f6-f89b7a728b2e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:06.655383 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e7081f29-9680-4bff-a6f6-f89b7a728b2e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:06.655498 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e7081f29-9680-4bff-a6f6-f89b7a728b2e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:06.656728 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e7081f29-9680-4bff-a6f6-f89b7a728b2e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:06.657419 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e7081f29-9680-4bff-a6f6-f89b7a728b2e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:06.658152 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e7081f29-9680-4bff-a6f6-f89b7a728b2e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:06.811215 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-e7081f29-9680-4bff-a6f6-f89b7a728b2e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:06.821740 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-e7081f29-9680-4bff-a6f6-f89b7a728b2e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:06.824025 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-e7081f29-9680-4bff-a6f6-f89b7a728b2e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:06.838267 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-e7081f29-9680-4bff-a6f6-f89b7a728b2e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1739 microversion: 2.20 time: 0.212788 Aug 10 11:35:06.841234 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 140/279] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:35:06 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1739 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:35:06.858926 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-7f626089-a9d2-4def-9505-bed20cd16711 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:06.862827 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-7f626089-a9d2-4def-9505-bed20cd16711 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:06.884700 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7f626089-a9d2-4def-9505-bed20cd16711 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:06.885945 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7f626089-a9d2-4def-9505-bed20cd16711 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:06.888982 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7f626089-a9d2-4def-9505-bed20cd16711 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:06.892438 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7f626089-a9d2-4def-9505-bed20cd16711 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:06.892940 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7f626089-a9d2-4def-9505-bed20cd16711 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:06.895593 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7f626089-a9d2-4def-9505-bed20cd16711 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:07.055190 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-8abf6ba4-ef22-48bf-8507-f3388f408909 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:07.064105 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-8abf6ba4-ef22-48bf-8507-f3388f408909 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1723 microversion: 2.1 time: 0.688632 Aug 10 11:35:07.064428 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-7f626089-a9d2-4def-9505-bed20cd16711 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:07.080331 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-7f626089-a9d2-4def-9505-bed20cd16711 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5" status: 200 len: 1369 microversion: 2.1 time: 0.230895 Aug 10 11:35:07.080795 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 140/280] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:06 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1723 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:07.087245 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 141/281] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:06 2022] GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5 => generated 1369 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:07.594612 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-2c91c0fb-edde-42dd-9778-3b9b2be08f3b req-bafa6554-b3d7-4a90-b575-b65b3c8ea9b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f70dab9f-931f-4e70-bb09-0a053d3220a5", "tag": "53b710b6-9aea-4621-bdee-7da9637f2bfd"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:35:07.605419 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-2c91c0fb-edde-42dd-9778-3b9b2be08f3b req-bafa6554-b3d7-4a90-b575-b65b3c8ea9b9 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:07.606481 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-2c91c0fb-edde-42dd-9778-3b9b2be08f3b req-bafa6554-b3d7-4a90-b575-b65b3c8ea9b9 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:07.607111 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-2c91c0fb-edde-42dd-9778-3b9b2be08f3b req-bafa6554-b3d7-4a90-b575-b65b3c8ea9b9 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:07.619247 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-2c91c0fb-edde-42dd-9778-3b9b2be08f3b req-bafa6554-b3d7-4a90-b575-b65b3c8ea9b9 service nova] Creating event network-changed:53b710b6-9aea-4621-bdee-7da9637f2bfd for instance f70dab9f-931f-4e70-bb09-0a053d3220a5 on hv-cinder-85272 Aug 10 11:35:07.624686 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-2c91c0fb-edde-42dd-9778-3b9b2be08f3b req-bafa6554-b3d7-4a90-b575-b65b3c8ea9b9 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033743 Aug 10 11:35:07.626168 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 141/282] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:35:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:35:07.870355 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-7e2fdc8d-73ec-4e93-b242-f07228058429 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:07.931495 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-7e2fdc8d-73ec-4e93-b242-f07228058429 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:07.931495 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7e2fdc8d-73ec-4e93-b242-f07228058429 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:07.931495 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7e2fdc8d-73ec-4e93-b242-f07228058429 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.050s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:07.931495 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7e2fdc8d-73ec-4e93-b242-f07228058429 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:07.931936 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7e2fdc8d-73ec-4e93-b242-f07228058429 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:07.931936 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7e2fdc8d-73ec-4e93-b242-f07228058429 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:07.932928 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7e2fdc8d-73ec-4e93-b242-f07228058429 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:08.098714 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-c4ebf7d5-a8ec-42ed-97f9-324b7638d8ff tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:08.098714 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-c4ebf7d5-a8ec-42ed-97f9-324b7638d8ff tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:08.114041 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c4ebf7d5-a8ec-42ed-97f9-324b7638d8ff tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:08.115812 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c4ebf7d5-a8ec-42ed-97f9-324b7638d8ff tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:08.120662 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c4ebf7d5-a8ec-42ed-97f9-324b7638d8ff tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:08.121096 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c4ebf7d5-a8ec-42ed-97f9-324b7638d8ff tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:08.121590 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c4ebf7d5-a8ec-42ed-97f9-324b7638d8ff tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:08.122046 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c4ebf7d5-a8ec-42ed-97f9-324b7638d8ff tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:08.234025 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-7e2fdc8d-73ec-4e93-b242-f07228058429 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:08.244562 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-7e2fdc8d-73ec-4e93-b242-f07228058429 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:08.245615 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-7e2fdc8d-73ec-4e93-b242-f07228058429 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:08.246921 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-7e2fdc8d-73ec-4e93-b242-f07228058429 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1739 microversion: 2.20 time: 0.388256 Aug 10 11:35:08.247835 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 142/283] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:35:07 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1739 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:35:08.252911 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f24a497b-dcf8-47dd-aeb0-2ce638ca1a50 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:08.254227 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-f24a497b-dcf8-47dd-aeb0-2ce638ca1a50 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:08.267688 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f24a497b-dcf8-47dd-aeb0-2ce638ca1a50 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:08.278185 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f24a497b-dcf8-47dd-aeb0-2ce638ca1a50 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:08.278663 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f24a497b-dcf8-47dd-aeb0-2ce638ca1a50 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:08.279391 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f24a497b-dcf8-47dd-aeb0-2ce638ca1a50 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:08.280162 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f24a497b-dcf8-47dd-aeb0-2ce638ca1a50 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:08.280764 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f24a497b-dcf8-47dd-aeb0-2ce638ca1a50 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:08.466900 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-f24a497b-dcf8-47dd-aeb0-2ce638ca1a50 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:08.475721 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-f24a497b-dcf8-47dd-aeb0-2ce638ca1a50 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5" status: 200 len: 1369 microversion: 2.1 time: 0.226169 Aug 10 11:35:08.477238 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 143/284] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:08 2022] GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5 => generated 1369 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:08.492361 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c4ebf7d5-a8ec-42ed-97f9-324b7638d8ff tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:08.501207 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-c4ebf7d5-a8ec-42ed-97f9-324b7638d8ff tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1723 microversion: 2.1 time: 0.414364 Aug 10 11:35:08.502345 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 142/285] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:08 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1723 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:09.271219 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-a5e4d9db-5643-4866-a20b-141672a899e1 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:09.272561 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-a5e4d9db-5643-4866-a20b-141672a899e1 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:09.279723 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a5e4d9db-5643-4866-a20b-141672a899e1 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:09.281176 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a5e4d9db-5643-4866-a20b-141672a899e1 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:09.281808 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a5e4d9db-5643-4866-a20b-141672a899e1 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:09.282731 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a5e4d9db-5643-4866-a20b-141672a899e1 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:09.283381 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a5e4d9db-5643-4866-a20b-141672a899e1 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:09.284052 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a5e4d9db-5643-4866-a20b-141672a899e1 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:09.498604 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-9175eafa-9e83-45bd-8e88-6fc4a1d62495 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:09.499302 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-9175eafa-9e83-45bd-8e88-6fc4a1d62495 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:09.506495 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-a5e4d9db-5643-4866-a20b-141672a899e1 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:09.511888 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9175eafa-9e83-45bd-8e88-6fc4a1d62495 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:09.512507 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9175eafa-9e83-45bd-8e88-6fc4a1d62495 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:09.515412 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9175eafa-9e83-45bd-8e88-6fc4a1d62495 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:09.516429 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9175eafa-9e83-45bd-8e88-6fc4a1d62495 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:09.518657 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-a5e4d9db-5643-4866-a20b-141672a899e1 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:09.519843 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9175eafa-9e83-45bd-8e88-6fc4a1d62495 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:09.521228 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-a5e4d9db-5643-4866-a20b-141672a899e1 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:09.522920 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-a5e4d9db-5643-4866-a20b-141672a899e1 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1739 microversion: 2.20 time: 0.255738 Aug 10 11:35:09.523637 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 144/286] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:35:09 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1739 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:35:09.526547 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9175eafa-9e83-45bd-8e88-6fc4a1d62495 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:09.529056 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-2d21ab6b-f0dd-486c-bb2e-ea16a2e95a67 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:09.530172 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-2d21ab6b-f0dd-486c-bb2e-ea16a2e95a67 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:09.562941 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2d21ab6b-f0dd-486c-bb2e-ea16a2e95a67 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:09.562941 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2d21ab6b-f0dd-486c-bb2e-ea16a2e95a67 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:09.562941 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2d21ab6b-f0dd-486c-bb2e-ea16a2e95a67 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:09.562941 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2d21ab6b-f0dd-486c-bb2e-ea16a2e95a67 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:09.563312 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2d21ab6b-f0dd-486c-bb2e-ea16a2e95a67 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:09.563312 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2d21ab6b-f0dd-486c-bb2e-ea16a2e95a67 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:09.783682 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-9175eafa-9e83-45bd-8e88-6fc4a1d62495 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:09.793901 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-9175eafa-9e83-45bd-8e88-6fc4a1d62495 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5" status: 200 len: 1369 microversion: 2.1 time: 0.298729 Aug 10 11:35:09.795376 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 143/287] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:09 2022] GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5 => generated 1369 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:09.801349 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-e4d8a359-15ae-4db3-8286-cb5d1eae8325 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1527801789", "imageRef": "99bbc441-5102-4a51-a496-cfbffeb3033a", "flavorRef": "452", "networks": [{"uuid": "17695128-e212-4a79-b800-0067981041a8"}]}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:35:09.833887 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-2d21ab6b-f0dd-486c-bb2e-ea16a2e95a67 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:09.844776 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-2d21ab6b-f0dd-486c-bb2e-ea16a2e95a67 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1723 microversion: 2.1 time: 0.319840 Aug 10 11:35:09.864262 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 145/288] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:09 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1723 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:09.880670 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.network.neutron [None req-e4d8a359-15ae-4db3-8286-cb5d1eae8325 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] validate_networks() for [('17695128-e212-4a79-b800-0067981041a8', None, None, None, None, None)] {{(pid=124682) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:35:10.348292 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-e4d8a359-15ae-4db3-8286-cb5d1eae8325 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Flavor limits 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:35:10.348715 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-e4d8a359-15ae-4db3-8286-cb5d1eae8325 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Image limits 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:35:10.349651 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-e4d8a359-15ae-4db3-8286-cb5d1eae8325 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Flavor pref 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:35:10.349934 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-e4d8a359-15ae-4db3-8286-cb5d1eae8325 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Image pref 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:35:10.350345 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-e4d8a359-15ae-4db3-8286-cb5d1eae8325 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:35:10.362576 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e4d8a359-15ae-4db3-8286-cb5d1eae8325 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:10.363994 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e4d8a359-15ae-4db3-8286-cb5d1eae8325 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:10.364612 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e4d8a359-15ae-4db3-8286-cb5d1eae8325 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:10.365644 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e4d8a359-15ae-4db3-8286-cb5d1eae8325 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:10.366284 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e4d8a359-15ae-4db3-8286-cb5d1eae8325 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:10.366880 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e4d8a359-15ae-4db3-8286-cb5d1eae8325 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:10.389819 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-e4d8a359-15ae-4db3-8286-cb5d1eae8325 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Getting quotas for project 8329fbf83b104200a04faaa9c454d708. Resources: {'ram', 'instances', 'cores'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:35:10.398302 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-e4d8a359-15ae-4db3-8286-cb5d1eae8325 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Getting quotas for user 24d35c64f3a748da9075622e08283aba and project 8329fbf83b104200a04faaa9c454d708. Resources: {'ram', 'instances', 'cores'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:35:10.411582 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-e4d8a359-15ae-4db3-8286-cb5d1eae8325 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Going to run 1 instances... {{(pid=124682) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:35:10.416164 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-e4d8a359-15ae-4db3-8286-cb5d1eae8325 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 95b0dee9-162e-4edc-98e5-a6d36ce71ec1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99bbc441-5102-4a51-a496-cfbffeb3033a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:35:10.553217 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-d4abe5cb-2aa7-4553-ab08-17e8be57b448 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:10.554545 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-d4abe5cb-2aa7-4553-ab08-17e8be57b448 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:10.555218 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-e4d8a359-15ae-4db3-8286-cb5d1eae8325 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.757954 Aug 10 11:35:10.555815 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 144/289] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Aug 10 11:35:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 11:35:10.567393 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-48ec29c5-f0ef-481e-a102-f6cb610cf619 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:10.568337 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-48ec29c5-f0ef-481e-a102-f6cb610cf619 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 95b0dee9-162e-4edc-98e5-a6d36ce71ec1] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:10.581045 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d4abe5cb-2aa7-4553-ab08-17e8be57b448 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:10.581680 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d4abe5cb-2aa7-4553-ab08-17e8be57b448 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:10.582991 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d4abe5cb-2aa7-4553-ab08-17e8be57b448 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:10.584136 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d4abe5cb-2aa7-4553-ab08-17e8be57b448 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:10.589561 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d4abe5cb-2aa7-4553-ab08-17e8be57b448 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:10.589561 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d4abe5cb-2aa7-4553-ab08-17e8be57b448 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:10.708708 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-48ec29c5-f0ef-481e-a102-f6cb610cf619 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d35c64f3a748da9075622e08283aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8329fbf83b104200a04faaa9c454d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:10.716326 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-48ec29c5-f0ef-481e-a102-f6cb610cf619 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] 10.222.0.62 "GET /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1" status: 200 len: 1219 microversion: 2.1 time: 0.153712 Aug 10 11:35:10.721459 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 145/290] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:10 2022] GET /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1 => generated 1219 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:10.823274 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-bfea8389-e4dc-465e-9abf-9312e9364afc tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:10.824219 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-bfea8389-e4dc-465e-9abf-9312e9364afc tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:10.832391 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bfea8389-e4dc-465e-9abf-9312e9364afc tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:10.843918 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bfea8389-e4dc-465e-9abf-9312e9364afc tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:10.844657 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bfea8389-e4dc-465e-9abf-9312e9364afc tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:10.845596 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bfea8389-e4dc-465e-9abf-9312e9364afc tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:10.848662 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bfea8389-e4dc-465e-9abf-9312e9364afc tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:10.852614 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bfea8389-e4dc-465e-9abf-9312e9364afc tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:10.888109 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=2 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:35:10.941418 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-d4abe5cb-2aa7-4553-ab08-17e8be57b448 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:10.961177 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-d4abe5cb-2aa7-4553-ab08-17e8be57b448 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:10.965014 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-d4abe5cb-2aa7-4553-ab08-17e8be57b448 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:10.967017 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-d4abe5cb-2aa7-4553-ab08-17e8be57b448 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1739 microversion: 2.20 time: 0.418754 Aug 10 11:35:10.971585 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 146/291] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:35:10 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1739 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:35:10.976673 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-91b9fb0f-d51e-41f8-ae6e-eb2fd1d36eb8 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:10.979601 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-91b9fb0f-d51e-41f8-ae6e-eb2fd1d36eb8 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:11.004495 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-91b9fb0f-d51e-41f8-ae6e-eb2fd1d36eb8 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:11.005311 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-91b9fb0f-d51e-41f8-ae6e-eb2fd1d36eb8 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:11.005936 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-91b9fb0f-d51e-41f8-ae6e-eb2fd1d36eb8 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:11.006855 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-91b9fb0f-d51e-41f8-ae6e-eb2fd1d36eb8 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:11.007499 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-91b9fb0f-d51e-41f8-ae6e-eb2fd1d36eb8 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:11.008165 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-91b9fb0f-d51e-41f8-ae6e-eb2fd1d36eb8 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:11.091131 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-bfea8389-e4dc-465e-9abf-9312e9364afc tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:11.099234 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-bfea8389-e4dc-465e-9abf-9312e9364afc tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5" status: 200 len: 1369 microversion: 2.1 time: 0.279498 Aug 10 11:35:11.116261 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 146/292] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:10 2022] GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5 => generated 1369 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:11.214372 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-91b9fb0f-d51e-41f8-ae6e-eb2fd1d36eb8 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:11.229325 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=12 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:35:11.243050 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-91b9fb0f-d51e-41f8-ae6e-eb2fd1d36eb8 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1723 microversion: 2.1 time: 0.269165 Aug 10 11:35:11.252502 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 147/293] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:10 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1723 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:11.739302 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-5efa3aab-e776-4618-9dd8-7332fb95a26c tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:11.740581 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-5efa3aab-e776-4618-9dd8-7332fb95a26c tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 95b0dee9-162e-4edc-98e5-a6d36ce71ec1] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:11.830519 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-5efa3aab-e776-4618-9dd8-7332fb95a26c tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d35c64f3a748da9075622e08283aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8329fbf83b104200a04faaa9c454d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:11.853099 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-5efa3aab-e776-4618-9dd8-7332fb95a26c tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] 10.222.0.62 "GET /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1" status: 200 len: 1219 microversion: 2.1 time: 0.118035 Aug 10 11:35:11.864102 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 147/294] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:11 2022] GET /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1 => generated 1219 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:35:11.997403 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-29a56883-3568-482f-bb17-13f32b0da1ff tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:11.998800 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-29a56883-3568-482f-bb17-13f32b0da1ff tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:12.007762 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-29a56883-3568-482f-bb17-13f32b0da1ff tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:12.015655 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-29a56883-3568-482f-bb17-13f32b0da1ff tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:12.015655 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-29a56883-3568-482f-bb17-13f32b0da1ff tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:12.015655 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-29a56883-3568-482f-bb17-13f32b0da1ff tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:12.015655 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-29a56883-3568-482f-bb17-13f32b0da1ff tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:12.016089 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-29a56883-3568-482f-bb17-13f32b0da1ff tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:12.133534 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-dce56762-812c-4428-bff4-572161e03b58 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:12.134376 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-dce56762-812c-4428-bff4-572161e03b58 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:12.156573 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-dce56762-812c-4428-bff4-572161e03b58 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:12.178465 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-dce56762-812c-4428-bff4-572161e03b58 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:12.178465 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-dce56762-812c-4428-bff4-572161e03b58 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:12.178465 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-dce56762-812c-4428-bff4-572161e03b58 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:12.178465 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-dce56762-812c-4428-bff4-572161e03b58 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:12.178783 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-dce56762-812c-4428-bff4-572161e03b58 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:12.194151 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-29a56883-3568-482f-bb17-13f32b0da1ff tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:12.208533 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-29a56883-3568-482f-bb17-13f32b0da1ff tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:12.210386 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-29a56883-3568-482f-bb17-13f32b0da1ff tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:12.212183 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-29a56883-3568-482f-bb17-13f32b0da1ff tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1739 microversion: 2.20 time: 0.218454 Aug 10 11:35:12.214598 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 148/295] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:35:11 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1739 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:35:12.267578 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-05d3068f-a1f6-49cb-b126-e1a61713febc tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:12.268581 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-05d3068f-a1f6-49cb-b126-e1a61713febc tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:12.275634 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-05d3068f-a1f6-49cb-b126-e1a61713febc tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:12.276189 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-05d3068f-a1f6-49cb-b126-e1a61713febc tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:12.276636 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-05d3068f-a1f6-49cb-b126-e1a61713febc tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:12.277344 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-05d3068f-a1f6-49cb-b126-e1a61713febc tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:12.277806 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-05d3068f-a1f6-49cb-b126-e1a61713febc tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:12.278291 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-05d3068f-a1f6-49cb-b126-e1a61713febc tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:12.354462 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-dce56762-812c-4428-bff4-572161e03b58 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:12.359573 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-dce56762-812c-4428-bff4-572161e03b58 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5" status: 200 len: 1369 microversion: 2.1 time: 0.231238 Aug 10 11:35:12.360190 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 148/296] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:12 2022] GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5 => generated 1369 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:35:12.418896 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-05d3068f-a1f6-49cb-b126-e1a61713febc tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:12.427558 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-05d3068f-a1f6-49cb-b126-e1a61713febc tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1723 microversion: 2.1 time: 0.164301 Aug 10 11:35:12.428211 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 149/297] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:12 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:35:12.889289 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-b70fb7a1-7f6f-41f1-bbe8-0db67bd4c7a4 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:12.889822 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-b70fb7a1-7f6f-41f1-bbe8-0db67bd4c7a4 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 95b0dee9-162e-4edc-98e5-a6d36ce71ec1] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:12.915495 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b70fb7a1-7f6f-41f1-bbe8-0db67bd4c7a4 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:12.916026 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b70fb7a1-7f6f-41f1-bbe8-0db67bd4c7a4 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:12.916649 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b70fb7a1-7f6f-41f1-bbe8-0db67bd4c7a4 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:12.923538 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b70fb7a1-7f6f-41f1-bbe8-0db67bd4c7a4 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:12.923538 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b70fb7a1-7f6f-41f1-bbe8-0db67bd4c7a4 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:12.923538 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b70fb7a1-7f6f-41f1-bbe8-0db67bd4c7a4 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:13.005825 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b70fb7a1-7f6f-41f1-bbe8-0db67bd4c7a4 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d35c64f3a748da9075622e08283aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8329fbf83b104200a04faaa9c454d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:13.017519 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-b70fb7a1-7f6f-41f1-bbe8-0db67bd4c7a4 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] 10.222.0.62 "GET /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1" status: 200 len: 1215 microversion: 2.1 time: 0.132251 Aug 10 11:35:13.019852 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 149/298] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:12 2022] GET /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1 => generated 1215 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:13.138580 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-210d8557-afbc-430a-b593-ae2bb37e1c68 req-2c0ce99d-6f4a-4716-aacf-fcb684e64afa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f70dab9f-931f-4e70-bb09-0a053d3220a5", "name": "network-vif-plugged", "status": "completed", "tag": "53b710b6-9aea-4621-bdee-7da9637f2bfd"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:35:13.159157 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-210d8557-afbc-430a-b593-ae2bb37e1c68 req-2c0ce99d-6f4a-4716-aacf-fcb684e64afa service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:13.160477 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-210d8557-afbc-430a-b593-ae2bb37e1c68 req-2c0ce99d-6f4a-4716-aacf-fcb684e64afa service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:13.161525 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-210d8557-afbc-430a-b593-ae2bb37e1c68 req-2c0ce99d-6f4a-4716-aacf-fcb684e64afa service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:13.177782 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-210d8557-afbc-430a-b593-ae2bb37e1c68 req-2c0ce99d-6f4a-4716-aacf-fcb684e64afa service nova] Creating event network-vif-plugged:53b710b6-9aea-4621-bdee-7da9637f2bfd for instance f70dab9f-931f-4e70-bb09-0a053d3220a5 on hv-cinder-85272 Aug 10 11:35:13.183465 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-210d8557-afbc-430a-b593-ae2bb37e1c68 req-2c0ce99d-6f4a-4716-aacf-fcb684e64afa service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049135 Aug 10 11:35:13.189478 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 150/299] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:35:13.237938 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-e6d2018d-fbd3-4e12-a931-bd79784c3e0c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:13.239714 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-e6d2018d-fbd3-4e12-a931-bd79784c3e0c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:13.257488 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e6d2018d-fbd3-4e12-a931-bd79784c3e0c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:13.258280 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e6d2018d-fbd3-4e12-a931-bd79784c3e0c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:13.259061 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e6d2018d-fbd3-4e12-a931-bd79784c3e0c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:13.259953 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e6d2018d-fbd3-4e12-a931-bd79784c3e0c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:13.260593 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e6d2018d-fbd3-4e12-a931-bd79784c3e0c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:13.261194 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e6d2018d-fbd3-4e12-a931-bd79784c3e0c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:13.383518 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-1614a01d-36f3-4d99-82ea-56006aaa1129 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:13.384649 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-1614a01d-36f3-4d99-82ea-56006aaa1129 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:13.399761 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1614a01d-36f3-4d99-82ea-56006aaa1129 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:13.400309 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1614a01d-36f3-4d99-82ea-56006aaa1129 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:13.400777 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1614a01d-36f3-4d99-82ea-56006aaa1129 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:13.401480 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1614a01d-36f3-4d99-82ea-56006aaa1129 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:13.402086 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1614a01d-36f3-4d99-82ea-56006aaa1129 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:13.402531 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1614a01d-36f3-4d99-82ea-56006aaa1129 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:13.488799 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-e6d2018d-fbd3-4e12-a931-bd79784c3e0c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:13.497708 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-e6d2018d-fbd3-4e12-a931-bd79784c3e0c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:13.499322 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-e6d2018d-fbd3-4e12-a931-bd79784c3e0c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:13.500639 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-e6d2018d-fbd3-4e12-a931-bd79784c3e0c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1739 microversion: 2.20 time: 0.267175 Aug 10 11:35:13.501276 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 150/300] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:35:13 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1739 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:35:13.506766 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-16b15779-a9d4-4516-9d34-8d104ab10714 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:13.507607 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-16b15779-a9d4-4516-9d34-8d104ab10714 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:13.527505 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-16b15779-a9d4-4516-9d34-8d104ab10714 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:13.528016 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-16b15779-a9d4-4516-9d34-8d104ab10714 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:13.528651 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-16b15779-a9d4-4516-9d34-8d104ab10714 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:13.529373 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-16b15779-a9d4-4516-9d34-8d104ab10714 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:13.529867 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-16b15779-a9d4-4516-9d34-8d104ab10714 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:13.530303 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-16b15779-a9d4-4516-9d34-8d104ab10714 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:13.576908 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-1614a01d-36f3-4d99-82ea-56006aaa1129 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:13.585069 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-1614a01d-36f3-4d99-82ea-56006aaa1129 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5" status: 200 len: 1369 microversion: 2.1 time: 0.206494 Aug 10 11:35:13.585637 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 151/301] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:13 2022] GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5 => generated 1369 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:13.671246 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-16b15779-a9d4-4516-9d34-8d104ab10714 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:13.680029 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-16b15779-a9d4-4516-9d34-8d104ab10714 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1723 microversion: 2.1 time: 0.177461 Aug 10 11:35:13.680772 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 151/302] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:13 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:14.043753 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-c7ee580e-ff03-4421-92b3-98957b7df250 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:14.045301 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-c7ee580e-ff03-4421-92b3-98957b7df250 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 95b0dee9-162e-4edc-98e5-a6d36ce71ec1] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:14.046322 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:35:14.051473 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c7ee580e-ff03-4421-92b3-98957b7df250 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:14.052013 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c7ee580e-ff03-4421-92b3-98957b7df250 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:14.052476 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c7ee580e-ff03-4421-92b3-98957b7df250 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:14.053090 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c7ee580e-ff03-4421-92b3-98957b7df250 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:14.053567 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c7ee580e-ff03-4421-92b3-98957b7df250 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:14.053999 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c7ee580e-ff03-4421-92b3-98957b7df250 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:14.121916 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-c7ee580e-ff03-4421-92b3-98957b7df250 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d35c64f3a748da9075622e08283aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8329fbf83b104200a04faaa9c454d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:14.138393 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-c7ee580e-ff03-4421-92b3-98957b7df250 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] 10.222.0.62 "GET /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1" status: 200 len: 1279 microversion: 2.1 time: 0.098479 Aug 10 11:35:14.138920 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 152/303] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:14 2022] GET /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1 => generated 1279 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:14.524495 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-2daa05a8-1a70-428c-acd8-e4367f418ea4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:14.525096 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-2daa05a8-1a70-428c-acd8-e4367f418ea4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:14.531380 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2daa05a8-1a70-428c-acd8-e4367f418ea4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:14.531873 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2daa05a8-1a70-428c-acd8-e4367f418ea4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:14.532335 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2daa05a8-1a70-428c-acd8-e4367f418ea4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:14.533025 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2daa05a8-1a70-428c-acd8-e4367f418ea4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:14.533474 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2daa05a8-1a70-428c-acd8-e4367f418ea4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:14.533894 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2daa05a8-1a70-428c-acd8-e4367f418ea4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:14.606937 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-4b6ae113-3743-4213-9aeb-b881e7635230 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:14.607823 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-4b6ae113-3743-4213-9aeb-b881e7635230 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:14.616287 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4b6ae113-3743-4213-9aeb-b881e7635230 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:14.616287 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4b6ae113-3743-4213-9aeb-b881e7635230 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:14.617062 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4b6ae113-3743-4213-9aeb-b881e7635230 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:14.617795 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4b6ae113-3743-4213-9aeb-b881e7635230 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:14.618256 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4b6ae113-3743-4213-9aeb-b881e7635230 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:14.618685 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4b6ae113-3743-4213-9aeb-b881e7635230 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:14.727681 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-2daa05a8-1a70-428c-acd8-e4367f418ea4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:14.736137 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-2daa05a8-1a70-428c-acd8-e4367f418ea4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:14.737880 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-2daa05a8-1a70-428c-acd8-e4367f418ea4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:14.739410 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-2daa05a8-1a70-428c-acd8-e4367f418ea4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1739 microversion: 2.20 time: 0.218904 Aug 10 11:35:14.740239 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 152/304] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:35:14 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1739 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:35:14.745820 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-fca34571-f080-4c17-b7b6-707c6f0cf9b4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:14.746606 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-fca34571-f080-4c17-b7b6-707c6f0cf9b4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:14.752879 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fca34571-f080-4c17-b7b6-707c6f0cf9b4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:14.753944 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fca34571-f080-4c17-b7b6-707c6f0cf9b4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:14.754599 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fca34571-f080-4c17-b7b6-707c6f0cf9b4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:14.755381 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fca34571-f080-4c17-b7b6-707c6f0cf9b4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:14.755918 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fca34571-f080-4c17-b7b6-707c6f0cf9b4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:14.756448 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fca34571-f080-4c17-b7b6-707c6f0cf9b4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:14.783681 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-4b6ae113-3743-4213-9aeb-b881e7635230 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:14.795942 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-4b6ae113-3743-4213-9aeb-b881e7635230 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5" status: 200 len: 1369 microversion: 2.1 time: 0.193093 Aug 10 11:35:14.796548 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 153/305] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:14 2022] GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5 => generated 1369 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:35:14.916144 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-fca34571-f080-4c17-b7b6-707c6f0cf9b4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:14.924041 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-fca34571-f080-4c17-b7b6-707c6f0cf9b4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1700 microversion: 2.1 time: 0.182600 Aug 10 11:35:14.924618 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 153/306] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:14 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1700 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:14.945118 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-d08d522e-4347-4b36-b436-5436b0578233 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:35:14.951183 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d08d522e-4347-4b36-b436-5436b0578233 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:14.951675 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d08d522e-4347-4b36-b436-5436b0578233 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:14.952146 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d08d522e-4347-4b36-b436-5436b0578233 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:14.977218 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-d08d522e-4347-4b36-b436-5436b0578233 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Going to try to start instance {{(pid=124683) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 10 11:35:14.993732 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=100 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:35:15.165194 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-9a2cb49d-f68c-4401-a160-7d51125dbdde tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:15.165828 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-9a2cb49d-f68c-4401-a160-7d51125dbdde tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 95b0dee9-162e-4edc-98e5-a6d36ce71ec1] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:15.167771 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:35:15.173195 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9a2cb49d-f68c-4401-a160-7d51125dbdde tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:15.173682 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9a2cb49d-f68c-4401-a160-7d51125dbdde tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:15.174115 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9a2cb49d-f68c-4401-a160-7d51125dbdde tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:15.174814 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9a2cb49d-f68c-4401-a160-7d51125dbdde tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:15.175546 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9a2cb49d-f68c-4401-a160-7d51125dbdde tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:15.176430 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9a2cb49d-f68c-4401-a160-7d51125dbdde tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:15.216017 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-d08d522e-4347-4b36-b436-5436b0578233 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "POST /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3/action" status: 202 len: 0 microversion: 2.1 time: 0.273572 Aug 10 11:35:15.216017 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 154/307] 10.222.0.62 () {60 vars in 1278 bytes} [Wed Aug 10 11:35:14 2022] POST /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:35:15.224836 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-fafc4ec2-7d64-47a6-8b32-0fb8fb771799 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:15.225660 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-fafc4ec2-7d64-47a6-8b32-0fb8fb771799 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:15.232733 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fafc4ec2-7d64-47a6-8b32-0fb8fb771799 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:15.233222 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fafc4ec2-7d64-47a6-8b32-0fb8fb771799 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:15.233664 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fafc4ec2-7d64-47a6-8b32-0fb8fb771799 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:15.234366 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fafc4ec2-7d64-47a6-8b32-0fb8fb771799 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:15.234816 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fafc4ec2-7d64-47a6-8b32-0fb8fb771799 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:15.235239 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fafc4ec2-7d64-47a6-8b32-0fb8fb771799 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:15.264562 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-9a2cb49d-f68c-4401-a160-7d51125dbdde tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d35c64f3a748da9075622e08283aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8329fbf83b104200a04faaa9c454d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:15.274586 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-9a2cb49d-f68c-4401-a160-7d51125dbdde tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] 10.222.0.62 "GET /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1" status: 200 len: 1289 microversion: 2.1 time: 0.113535 Aug 10 11:35:15.275167 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 154/308] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:15 2022] GET /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1 => generated 1289 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:35:15.367018 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-fafc4ec2-7d64-47a6-8b32-0fb8fb771799 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:15.375919 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-fafc4ec2-7d64-47a6-8b32-0fb8fb771799 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1709 microversion: 2.1 time: 0.155547 Aug 10 11:35:15.377522 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 155/309] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:15 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1709 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:15.761315 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-e2537d06-4762-421e-a2c9-8197983b230f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:15.761924 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-e2537d06-4762-421e-a2c9-8197983b230f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:15.768569 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e2537d06-4762-421e-a2c9-8197983b230f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:15.769215 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e2537d06-4762-421e-a2c9-8197983b230f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:15.769676 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e2537d06-4762-421e-a2c9-8197983b230f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:15.770386 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e2537d06-4762-421e-a2c9-8197983b230f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:15.770836 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e2537d06-4762-421e-a2c9-8197983b230f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:15.771259 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e2537d06-4762-421e-a2c9-8197983b230f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:15.817175 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-ccc72270-fe13-49ee-9d2e-4c8d18eecf2f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:15.817814 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-ccc72270-fe13-49ee-9d2e-4c8d18eecf2f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:15.824169 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ccc72270-fe13-49ee-9d2e-4c8d18eecf2f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:15.824676 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ccc72270-fe13-49ee-9d2e-4c8d18eecf2f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:15.825110 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ccc72270-fe13-49ee-9d2e-4c8d18eecf2f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:15.825824 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ccc72270-fe13-49ee-9d2e-4c8d18eecf2f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:15.826397 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ccc72270-fe13-49ee-9d2e-4c8d18eecf2f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:15.826824 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ccc72270-fe13-49ee-9d2e-4c8d18eecf2f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:15.901897 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-e2537d06-4762-421e-a2c9-8197983b230f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:15.910089 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-e2537d06-4762-421e-a2c9-8197983b230f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:15.911605 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-e2537d06-4762-421e-a2c9-8197983b230f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:15.912782 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-e2537d06-4762-421e-a2c9-8197983b230f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1721 microversion: 2.20 time: 0.155427 Aug 10 11:35:15.913777 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 155/310] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:35:15 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:35:15.958109 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-ccc72270-fe13-49ee-9d2e-4c8d18eecf2f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:15.965665 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-ccc72270-fe13-49ee-9d2e-4c8d18eecf2f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5" status: 200 len: 1563 microversion: 2.1 time: 0.152495 Aug 10 11:35:15.966237 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 156/311] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:15 2022] GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5 => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:35:15.985885 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-f1a5ec1c-fc6e-4b82-9b00-aba86dd0ea68 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:15.986378 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-f1a5ec1c-fc6e-4b82-9b00-aba86dd0ea68 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:15.992901 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f1a5ec1c-fc6e-4b82-9b00-aba86dd0ea68 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:15.993377 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f1a5ec1c-fc6e-4b82-9b00-aba86dd0ea68 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:15.993811 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f1a5ec1c-fc6e-4b82-9b00-aba86dd0ea68 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:15.994546 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f1a5ec1c-fc6e-4b82-9b00-aba86dd0ea68 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:15.995001 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f1a5ec1c-fc6e-4b82-9b00-aba86dd0ea68 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:15.995421 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f1a5ec1c-fc6e-4b82-9b00-aba86dd0ea68 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:16.072007 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-f1a5ec1c-fc6e-4b82-9b00-aba86dd0ea68 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089966 Aug 10 11:35:16.072595 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 156/312] 10.222.0.62 () {58 vars in 1275 bytes} [Wed Aug 10 11:35:15 2022] GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:35:16.296638 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-d5283513-e0fe-47b6-8c10-b837a61ae7e7 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:16.297258 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-d5283513-e0fe-47b6-8c10-b837a61ae7e7 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 95b0dee9-162e-4edc-98e5-a6d36ce71ec1] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:16.304082 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d5283513-e0fe-47b6-8c10-b837a61ae7e7 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:16.304579 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d5283513-e0fe-47b6-8c10-b837a61ae7e7 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:16.305018 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d5283513-e0fe-47b6-8c10-b837a61ae7e7 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:16.305734 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d5283513-e0fe-47b6-8c10-b837a61ae7e7 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:16.306187 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d5283513-e0fe-47b6-8c10-b837a61ae7e7 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:16.306618 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d5283513-e0fe-47b6-8c10-b837a61ae7e7 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:16.401517 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-5bc7a2e0-97e5-4cc6-984e-14330c2a5dcd tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:16.402132 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-5bc7a2e0-97e5-4cc6-984e-14330c2a5dcd tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:16.408119 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5bc7a2e0-97e5-4cc6-984e-14330c2a5dcd tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:16.409164 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5bc7a2e0-97e5-4cc6-984e-14330c2a5dcd tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:16.409164 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5bc7a2e0-97e5-4cc6-984e-14330c2a5dcd tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:16.409757 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5bc7a2e0-97e5-4cc6-984e-14330c2a5dcd tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:16.410315 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5bc7a2e0-97e5-4cc6-984e-14330c2a5dcd tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:16.410742 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5bc7a2e0-97e5-4cc6-984e-14330c2a5dcd tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:16.426218 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=100 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:35:16.440529 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-d5283513-e0fe-47b6-8c10-b837a61ae7e7 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d35c64f3a748da9075622e08283aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8329fbf83b104200a04faaa9c454d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:16.450459 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-d5283513-e0fe-47b6-8c10-b837a61ae7e7 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] 10.222.0.62 "GET /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1" status: 200 len: 1319 microversion: 2.1 time: 0.157652 Aug 10 11:35:16.451319 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 157/313] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:16 2022] GET /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:16.645852 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-5bc7a2e0-97e5-4cc6-984e-14330c2a5dcd tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:16.655132 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-5bc7a2e0-97e5-4cc6-984e-14330c2a5dcd tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1709 microversion: 2.1 time: 0.257383 Aug 10 11:35:16.655699 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 157/314] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:16 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1709 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:35:16.935595 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-1b9bfeaa-089f-444e-b77a-037d813c84d5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:16.936258 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-1b9bfeaa-089f-444e-b77a-037d813c84d5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:16.943880 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1b9bfeaa-089f-444e-b77a-037d813c84d5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:16.944413 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1b9bfeaa-089f-444e-b77a-037d813c84d5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:16.944847 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1b9bfeaa-089f-444e-b77a-037d813c84d5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:16.945532 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1b9bfeaa-089f-444e-b77a-037d813c84d5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:16.945981 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1b9bfeaa-089f-444e-b77a-037d813c84d5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:16.946404 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1b9bfeaa-089f-444e-b77a-037d813c84d5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:17.082104 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-1b9bfeaa-089f-444e-b77a-037d813c84d5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:17.090661 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-1b9bfeaa-089f-444e-b77a-037d813c84d5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:17.092212 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-1b9bfeaa-089f-444e-b77a-037d813c84d5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:17.093389 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-1b9bfeaa-089f-444e-b77a-037d813c84d5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1721 microversion: 2.20 time: 0.161696 Aug 10 11:35:17.094021 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 158/315] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:35:16 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:35:17.349560 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-024a8223-5490-4358-8505-f8eb7f81f4da req-99e81af2-e44f-453f-8dbb-32005f7cdac3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f70dab9f-931f-4e70-bb09-0a053d3220a5", "tag": "53b710b6-9aea-4621-bdee-7da9637f2bfd"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:35:17.359407 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-024a8223-5490-4358-8505-f8eb7f81f4da req-99e81af2-e44f-453f-8dbb-32005f7cdac3 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:17.359892 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-024a8223-5490-4358-8505-f8eb7f81f4da req-99e81af2-e44f-453f-8dbb-32005f7cdac3 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:17.360360 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-024a8223-5490-4358-8505-f8eb7f81f4da req-99e81af2-e44f-453f-8dbb-32005f7cdac3 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:17.371404 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-024a8223-5490-4358-8505-f8eb7f81f4da req-99e81af2-e44f-453f-8dbb-32005f7cdac3 service nova] Creating event network-changed:53b710b6-9aea-4621-bdee-7da9637f2bfd for instance f70dab9f-931f-4e70-bb09-0a053d3220a5 on hv-cinder-85272 Aug 10 11:35:17.376466 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-024a8223-5490-4358-8505-f8eb7f81f4da req-99e81af2-e44f-453f-8dbb-32005f7cdac3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030785 Aug 10 11:35:17.377054 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 158/316] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:35:17.472985 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f4146a58-4d3c-430a-8ded-dac94e70d365 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:17.473555 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-f4146a58-4d3c-430a-8ded-dac94e70d365 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 95b0dee9-162e-4edc-98e5-a6d36ce71ec1] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:17.479672 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f4146a58-4d3c-430a-8ded-dac94e70d365 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:17.480327 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f4146a58-4d3c-430a-8ded-dac94e70d365 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:17.480769 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f4146a58-4d3c-430a-8ded-dac94e70d365 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:17.481477 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f4146a58-4d3c-430a-8ded-dac94e70d365 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:17.481932 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f4146a58-4d3c-430a-8ded-dac94e70d365 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:17.482355 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f4146a58-4d3c-430a-8ded-dac94e70d365 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:17.622272 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-f4146a58-4d3c-430a-8ded-dac94e70d365 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d35c64f3a748da9075622e08283aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8329fbf83b104200a04faaa9c454d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:17.633022 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-f4146a58-4d3c-430a-8ded-dac94e70d365 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] 10.222.0.62 "GET /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1" status: 200 len: 1319 microversion: 2.1 time: 0.163960 Aug 10 11:35:17.634204 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 159/317] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:17 2022] GET /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:17.679993 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-c0083b07-7da8-4d2e-a042-44290e33f8ac tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:17.681204 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-c0083b07-7da8-4d2e-a042-44290e33f8ac tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:17.688223 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c0083b07-7da8-4d2e-a042-44290e33f8ac tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:17.688839 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c0083b07-7da8-4d2e-a042-44290e33f8ac tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:17.689389 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c0083b07-7da8-4d2e-a042-44290e33f8ac tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:17.690156 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c0083b07-7da8-4d2e-a042-44290e33f8ac tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:17.690482 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c0083b07-7da8-4d2e-a042-44290e33f8ac tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:17.691046 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c0083b07-7da8-4d2e-a042-44290e33f8ac tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:17.849330 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c0083b07-7da8-4d2e-a042-44290e33f8ac tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:17.858732 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-c0083b07-7da8-4d2e-a042-44290e33f8ac tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1709 microversion: 2.1 time: 0.185594 Aug 10 11:35:17.859572 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 159/318] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:17 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1709 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:18.117084 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-555f8c80-e92b-4ca6-b391-321ddaecc8ab tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:18.117695 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-555f8c80-e92b-4ca6-b391-321ddaecc8ab tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:18.123816 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-555f8c80-e92b-4ca6-b391-321ddaecc8ab tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:18.124338 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-555f8c80-e92b-4ca6-b391-321ddaecc8ab tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:18.124771 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-555f8c80-e92b-4ca6-b391-321ddaecc8ab tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:18.125461 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-555f8c80-e92b-4ca6-b391-321ddaecc8ab tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:18.125974 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-555f8c80-e92b-4ca6-b391-321ddaecc8ab tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:18.126388 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-555f8c80-e92b-4ca6-b391-321ddaecc8ab tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:18.273464 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-555f8c80-e92b-4ca6-b391-321ddaecc8ab tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:18.281956 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-555f8c80-e92b-4ca6-b391-321ddaecc8ab tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:18.292230 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-555f8c80-e92b-4ca6-b391-321ddaecc8ab tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:18.296238 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-555f8c80-e92b-4ca6-b391-321ddaecc8ab tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1721 microversion: 2.20 time: 0.183336 Aug 10 11:35:18.310151 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 160/319] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:35:18 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1721 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:35:18.654695 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-0a7cfa9b-e92b-4ac3-b1f4-6fe631ea4de0 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:18.655553 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-0a7cfa9b-e92b-4ac3-b1f4-6fe631ea4de0 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 95b0dee9-162e-4edc-98e5-a6d36ce71ec1] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:18.666387 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0a7cfa9b-e92b-4ac3-b1f4-6fe631ea4de0 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:18.667771 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0a7cfa9b-e92b-4ac3-b1f4-6fe631ea4de0 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:18.668502 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0a7cfa9b-e92b-4ac3-b1f4-6fe631ea4de0 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:18.669490 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0a7cfa9b-e92b-4ac3-b1f4-6fe631ea4de0 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:18.670170 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0a7cfa9b-e92b-4ac3-b1f4-6fe631ea4de0 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:18.670827 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0a7cfa9b-e92b-4ac3-b1f4-6fe631ea4de0 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:18.886240 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-5be2281f-192e-4dee-905c-8fde412e4f27 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:18.888333 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-5be2281f-192e-4dee-905c-8fde412e4f27 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:18.898298 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5be2281f-192e-4dee-905c-8fde412e4f27 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:18.899098 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5be2281f-192e-4dee-905c-8fde412e4f27 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:18.899889 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5be2281f-192e-4dee-905c-8fde412e4f27 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:18.900841 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5be2281f-192e-4dee-905c-8fde412e4f27 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:18.901474 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5be2281f-192e-4dee-905c-8fde412e4f27 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:18.902142 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5be2281f-192e-4dee-905c-8fde412e4f27 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:18.939708 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-0a7cfa9b-e92b-4ac3-b1f4-6fe631ea4de0 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d35c64f3a748da9075622e08283aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8329fbf83b104200a04faaa9c454d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:18.951710 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-0a7cfa9b-e92b-4ac3-b1f4-6fe631ea4de0 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] 10.222.0.62 "GET /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1" status: 200 len: 1319 microversion: 2.1 time: 0.300713 Aug 10 11:35:18.966670 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 160/320] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:18 2022] GET /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1 => generated 1319 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:19.324329 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-581aefb8-ca45-4232-916d-65ab31832133 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:19.325185 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-581aefb8-ca45-4232-916d-65ab31832133 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:19.332681 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-581aefb8-ca45-4232-916d-65ab31832133 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:19.333515 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-581aefb8-ca45-4232-916d-65ab31832133 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:19.334111 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-581aefb8-ca45-4232-916d-65ab31832133 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:19.334970 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-581aefb8-ca45-4232-916d-65ab31832133 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:19.335592 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-581aefb8-ca45-4232-916d-65ab31832133 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:19.336211 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-581aefb8-ca45-4232-916d-65ab31832133 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:19.413005 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-5be2281f-192e-4dee-905c-8fde412e4f27 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:19.422768 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-5be2281f-192e-4dee-905c-8fde412e4f27 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1709 microversion: 2.1 time: 0.541169 Aug 10 11:35:19.423340 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 161/321] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:18 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1709 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:35:19.642246 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-581aefb8-ca45-4232-916d-65ab31832133 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:19.654318 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-581aefb8-ca45-4232-916d-65ab31832133 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:19.655828 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-581aefb8-ca45-4232-916d-65ab31832133 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:19.657020 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-581aefb8-ca45-4232-916d-65ab31832133 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1721 microversion: 2.20 time: 0.337856 Aug 10 11:35:19.662894 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 161/322] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:35:19 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1721 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:35:19.711571 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-d75f8362-88e8-497d-9117-46bce2cd37ee req-94f22d4b-484b-437c-8873-5494eddd68f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95b0dee9-162e-4edc-98e5-a6d36ce71ec1", "tag": "484483b2-57e1-4178-9ceb-6fe32dbb0e0b"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:35:19.722150 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-d75f8362-88e8-497d-9117-46bce2cd37ee req-94f22d4b-484b-437c-8873-5494eddd68f7 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:19.724485 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-d75f8362-88e8-497d-9117-46bce2cd37ee req-94f22d4b-484b-437c-8873-5494eddd68f7 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:19.724485 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-d75f8362-88e8-497d-9117-46bce2cd37ee req-94f22d4b-484b-437c-8873-5494eddd68f7 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:19.736473 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-d75f8362-88e8-497d-9117-46bce2cd37ee req-94f22d4b-484b-437c-8873-5494eddd68f7 service nova] Creating event network-changed:484483b2-57e1-4178-9ceb-6fe32dbb0e0b for instance 95b0dee9-162e-4edc-98e5-a6d36ce71ec1 on hv-cinder-85272 Aug 10 11:35:19.740464 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-f45e3c53-8706-4e41-9515-c1af0e742eb4 req-c263803e-857f-4ece-a6bf-f4c348e63180 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e6ed242-956f-4b14-8520-18920447bf05", "name": "network-vif-unplugged", "status": "completed", "tag": "f3f3926f-a2b3-40b5-a25f-a37b15cc0401"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:35:19.746682 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-d75f8362-88e8-497d-9117-46bce2cd37ee req-94f22d4b-484b-437c-8873-5494eddd68f7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039057 Aug 10 11:35:19.747637 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 162/323] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:35:19.754003 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-f45e3c53-8706-4e41-9515-c1af0e742eb4 req-c263803e-857f-4ece-a6bf-f4c348e63180 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:19.754003 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-f45e3c53-8706-4e41-9515-c1af0e742eb4 req-c263803e-857f-4ece-a6bf-f4c348e63180 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:19.754003 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-f45e3c53-8706-4e41-9515-c1af0e742eb4 req-c263803e-857f-4ece-a6bf-f4c348e63180 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:19.777919 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-f45e3c53-8706-4e41-9515-c1af0e742eb4 req-c263803e-857f-4ece-a6bf-f4c348e63180 service nova] Creating event network-vif-unplugged:f3f3926f-a2b3-40b5-a25f-a37b15cc0401 for instance 9e6ed242-956f-4b14-8520-18920447bf05 on hv-cinder-85272 Aug 10 11:35:19.783544 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-f45e3c53-8706-4e41-9515-c1af0e742eb4 req-c263803e-857f-4ece-a6bf-f4c348e63180 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047014 Aug 10 11:35:19.784344 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 162/324] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:35:19.973067 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-7b340be7-3c0f-4247-ab47-5532e417ce7f tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:19.973778 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-7b340be7-3c0f-4247-ab47-5532e417ce7f tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 95b0dee9-162e-4edc-98e5-a6d36ce71ec1] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:19.979931 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7b340be7-3c0f-4247-ab47-5532e417ce7f tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:19.980449 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7b340be7-3c0f-4247-ab47-5532e417ce7f tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:19.980886 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7b340be7-3c0f-4247-ab47-5532e417ce7f tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:19.981605 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7b340be7-3c0f-4247-ab47-5532e417ce7f tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:19.982176 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7b340be7-3c0f-4247-ab47-5532e417ce7f tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:19.982608 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7b340be7-3c0f-4247-ab47-5532e417ce7f tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:20.135870 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-7b340be7-3c0f-4247-ab47-5532e417ce7f tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d35c64f3a748da9075622e08283aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8329fbf83b104200a04faaa9c454d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:20.143601 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-7b340be7-3c0f-4247-ab47-5532e417ce7f tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] 10.222.0.62 "GET /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1" status: 200 len: 1319 microversion: 2.1 time: 0.174972 Aug 10 11:35:20.144644 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 163/325] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:19 2022] GET /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:20.446404 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-6b28f777-faea-4e2c-8b27-b00135b8fd73 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:20.446674 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-6b28f777-faea-4e2c-8b27-b00135b8fd73 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:20.448651 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=2 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:35:20.453733 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6b28f777-faea-4e2c-8b27-b00135b8fd73 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:20.454216 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6b28f777-faea-4e2c-8b27-b00135b8fd73 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:20.454647 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6b28f777-faea-4e2c-8b27-b00135b8fd73 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:20.455339 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6b28f777-faea-4e2c-8b27-b00135b8fd73 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:20.455788 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6b28f777-faea-4e2c-8b27-b00135b8fd73 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:20.456234 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6b28f777-faea-4e2c-8b27-b00135b8fd73 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:20.589675 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-6b28f777-faea-4e2c-8b27-b00135b8fd73 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:20.597923 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-6b28f777-faea-4e2c-8b27-b00135b8fd73 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1709 microversion: 2.1 time: 0.156948 Aug 10 11:35:20.598488 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 163/326] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:20 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1709 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:20.681102 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-c98d7211-0052-44fd-879b-4d58af30b640 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:20.681721 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-c98d7211-0052-44fd-879b-4d58af30b640 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:20.687714 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c98d7211-0052-44fd-879b-4d58af30b640 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:20.688407 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c98d7211-0052-44fd-879b-4d58af30b640 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:20.688855 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c98d7211-0052-44fd-879b-4d58af30b640 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:20.689612 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c98d7211-0052-44fd-879b-4d58af30b640 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:20.690075 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c98d7211-0052-44fd-879b-4d58af30b640 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:20.690509 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c98d7211-0052-44fd-879b-4d58af30b640 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:20.857565 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-c98d7211-0052-44fd-879b-4d58af30b640 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:20.865839 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-c98d7211-0052-44fd-879b-4d58af30b640 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:20.867342 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-c98d7211-0052-44fd-879b-4d58af30b640 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:20.868522 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-c98d7211-0052-44fd-879b-4d58af30b640 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1721 microversion: 2.20 time: 0.191350 Aug 10 11:35:20.869084 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 164/327] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:35:20 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1721 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:35:21.165265 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-5dece3dd-770b-400f-914d-27312355d0ca tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:21.167750 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-5dece3dd-770b-400f-914d-27312355d0ca tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 95b0dee9-162e-4edc-98e5-a6d36ce71ec1] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:21.179016 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5dece3dd-770b-400f-914d-27312355d0ca tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:21.179938 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5dece3dd-770b-400f-914d-27312355d0ca tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:21.185946 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5dece3dd-770b-400f-914d-27312355d0ca tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:21.185946 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5dece3dd-770b-400f-914d-27312355d0ca tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:21.185946 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5dece3dd-770b-400f-914d-27312355d0ca tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:21.185946 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5dece3dd-770b-400f-914d-27312355d0ca tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:21.319905 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-5dece3dd-770b-400f-914d-27312355d0ca tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d35c64f3a748da9075622e08283aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8329fbf83b104200a04faaa9c454d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:21.327212 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-5dece3dd-770b-400f-914d-27312355d0ca tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] 10.222.0.62 "GET /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1" status: 200 len: 1319 microversion: 2.1 time: 0.166600 Aug 10 11:35:21.327777 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 164/328] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:21 2022] GET /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:21.619257 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-3eca2aad-5df1-4034-9008-68d35ea28542 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:21.620498 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-3eca2aad-5df1-4034-9008-68d35ea28542 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:21.629028 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3eca2aad-5df1-4034-9008-68d35ea28542 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:21.629902 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3eca2aad-5df1-4034-9008-68d35ea28542 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:21.630511 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3eca2aad-5df1-4034-9008-68d35ea28542 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:21.631404 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3eca2aad-5df1-4034-9008-68d35ea28542 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:21.631868 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3eca2aad-5df1-4034-9008-68d35ea28542 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:21.632331 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3eca2aad-5df1-4034-9008-68d35ea28542 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:21.789403 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-3eca2aad-5df1-4034-9008-68d35ea28542 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:21.797476 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-3eca2aad-5df1-4034-9008-68d35ea28542 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1709 microversion: 2.1 time: 0.182443 Aug 10 11:35:21.798040 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 165/329] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:21 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1709 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:21.893324 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-a6e508fc-7799-4458-8ea1-6f5c6b1595c0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:21.894571 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-a6e508fc-7799-4458-8ea1-6f5c6b1595c0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:21.896648 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=12 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:35:21.901453 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a6e508fc-7799-4458-8ea1-6f5c6b1595c0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:21.901940 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a6e508fc-7799-4458-8ea1-6f5c6b1595c0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:21.902379 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a6e508fc-7799-4458-8ea1-6f5c6b1595c0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:21.903129 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a6e508fc-7799-4458-8ea1-6f5c6b1595c0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:21.903581 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a6e508fc-7799-4458-8ea1-6f5c6b1595c0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:21.904033 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a6e508fc-7799-4458-8ea1-6f5c6b1595c0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:22.038539 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-a6e508fc-7799-4458-8ea1-6f5c6b1595c0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:22.047421 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-a6e508fc-7799-4458-8ea1-6f5c6b1595c0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:22.049116 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-a6e508fc-7799-4458-8ea1-6f5c6b1595c0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:22.051505 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-a6e508fc-7799-4458-8ea1-6f5c6b1595c0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1721 microversion: 2.20 time: 0.162234 Aug 10 11:35:22.053041 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 165/330] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:35:21 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:35:22.349398 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-2d392563-e2a8-462a-913a-bf4b032643f1 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:22.350349 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-2d392563-e2a8-462a-913a-bf4b032643f1 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 95b0dee9-162e-4edc-98e5-a6d36ce71ec1] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:22.356785 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2d392563-e2a8-462a-913a-bf4b032643f1 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:22.357346 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2d392563-e2a8-462a-913a-bf4b032643f1 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:22.357921 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2d392563-e2a8-462a-913a-bf4b032643f1 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:22.358710 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2d392563-e2a8-462a-913a-bf4b032643f1 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:22.359214 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2d392563-e2a8-462a-913a-bf4b032643f1 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:22.359651 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2d392563-e2a8-462a-913a-bf4b032643f1 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:22.522490 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-2d392563-e2a8-462a-913a-bf4b032643f1 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d35c64f3a748da9075622e08283aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8329fbf83b104200a04faaa9c454d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:22.530046 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-2d392563-e2a8-462a-913a-bf4b032643f1 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] 10.222.0.62 "GET /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1" status: 200 len: 1319 microversion: 2.1 time: 0.185185 Aug 10 11:35:22.530708 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 166/331] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:22 2022] GET /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1 => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:22.819414 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-e40c0df2-16fd-429f-8249-7c0a83f62dc4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:22.820089 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-e40c0df2-16fd-429f-8249-7c0a83f62dc4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:22.826635 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e40c0df2-16fd-429f-8249-7c0a83f62dc4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:22.827193 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e40c0df2-16fd-429f-8249-7c0a83f62dc4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:22.827631 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e40c0df2-16fd-429f-8249-7c0a83f62dc4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:22.828357 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e40c0df2-16fd-429f-8249-7c0a83f62dc4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:22.829030 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e40c0df2-16fd-429f-8249-7c0a83f62dc4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:22.829458 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e40c0df2-16fd-429f-8249-7c0a83f62dc4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:22.995942 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-e40c0df2-16fd-429f-8249-7c0a83f62dc4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:23.006005 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-e40c0df2-16fd-429f-8249-7c0a83f62dc4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1713 microversion: 2.1 time: 0.190638 Aug 10 11:35:23.006590 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 166/332] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:22 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1713 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:23.075229 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-9ec85e51-7f61-4ed1-8a8c-8497bd20a1a2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:23.076045 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-9ec85e51-7f61-4ed1-8a8c-8497bd20a1a2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:23.082766 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9ec85e51-7f61-4ed1-8a8c-8497bd20a1a2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:23.083298 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9ec85e51-7f61-4ed1-8a8c-8497bd20a1a2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:23.083747 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9ec85e51-7f61-4ed1-8a8c-8497bd20a1a2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:23.084498 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9ec85e51-7f61-4ed1-8a8c-8497bd20a1a2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:23.084955 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9ec85e51-7f61-4ed1-8a8c-8497bd20a1a2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:23.085387 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9ec85e51-7f61-4ed1-8a8c-8497bd20a1a2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:23.232866 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-9ec85e51-7f61-4ed1-8a8c-8497bd20a1a2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:23.241878 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-9ec85e51-7f61-4ed1-8a8c-8497bd20a1a2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:23.243322 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-9ec85e51-7f61-4ed1-8a8c-8497bd20a1a2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:23.244506 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-9ec85e51-7f61-4ed1-8a8c-8497bd20a1a2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1664 microversion: 2.20 time: 0.173331 Aug 10 11:35:23.245072 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 167/333] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:35:23 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1664 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:35:23.267011 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-12ba7b1a-81e8-46bd-87c3-d1aacf5420fc tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c503898-e6f2-4f33-89ad-5fff81617329"}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:35:23.271285 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-12ba7b1a-81e8-46bd-87c3-d1aacf5420fc tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:23.275680 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-12ba7b1a-81e8-46bd-87c3-d1aacf5420fc tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:23.276217 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-12ba7b1a-81e8-46bd-87c3-d1aacf5420fc tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:23.276659 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-12ba7b1a-81e8-46bd-87c3-d1aacf5420fc tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:23.277351 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-12ba7b1a-81e8-46bd-87c3-d1aacf5420fc tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:23.277812 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-12ba7b1a-81e8-46bd-87c3-d1aacf5420fc tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:23.278422 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-12ba7b1a-81e8-46bd-87c3-d1aacf5420fc tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:23.552546 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-02f7b24c-1861-4543-9a7d-17774694a38e tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:23.553147 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-02f7b24c-1861-4543-9a7d-17774694a38e tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 95b0dee9-162e-4edc-98e5-a6d36ce71ec1] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:23.563874 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-02f7b24c-1861-4543-9a7d-17774694a38e tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:23.563874 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-02f7b24c-1861-4543-9a7d-17774694a38e tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:23.563874 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-02f7b24c-1861-4543-9a7d-17774694a38e tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:23.563874 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-02f7b24c-1861-4543-9a7d-17774694a38e tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:23.564246 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-02f7b24c-1861-4543-9a7d-17774694a38e tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:23.564246 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-02f7b24c-1861-4543-9a7d-17774694a38e tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:23.701739 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-02f7b24c-1861-4543-9a7d-17774694a38e tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d35c64f3a748da9075622e08283aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8329fbf83b104200a04faaa9c454d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:23.709672 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-02f7b24c-1861-4543-9a7d-17774694a38e tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] 10.222.0.62 "GET /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1" status: 200 len: 1319 microversion: 2.1 time: 0.162923 Aug 10 11:35:23.710412 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 168/334] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:23 2022] GET /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:35:24.299269 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-12ba7b1a-81e8-46bd-87c3-d1aacf5420fc tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "POST /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.036614 Aug 10 11:35:24.299910 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 167/335] 10.222.0.62 () {62 vars in 1364 bytes} [Wed Aug 10 11:35:23 2022] POST /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05/os-volume_attachments => generated 188 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:35:24.438659 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-d7e138d0-dbab-4a4b-ad21-fdcf72619531 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:35:24.439253 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-d7e138d0-dbab-4a4b-ad21-fdcf72619531 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:24.445916 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d7e138d0-dbab-4a4b-ad21-fdcf72619531 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:24.446402 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d7e138d0-dbab-4a4b-ad21-fdcf72619531 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:24.446836 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d7e138d0-dbab-4a4b-ad21-fdcf72619531 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:24.447522 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d7e138d0-dbab-4a4b-ad21-fdcf72619531 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:24.448270 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d7e138d0-dbab-4a4b-ad21-fdcf72619531 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:24.448905 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d7e138d0-dbab-4a4b-ad21-fdcf72619531 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:24.496253 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-d7e138d0-dbab-4a4b-ad21-fdcf72619531 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124683) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 10 11:35:24.730592 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-6aa0892a-c6a0-44a7-a6d8-9f7cf4886170 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:24.731423 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-6aa0892a-c6a0-44a7-a6d8-9f7cf4886170 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 95b0dee9-162e-4edc-98e5-a6d36ce71ec1] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:24.738391 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6aa0892a-c6a0-44a7-a6d8-9f7cf4886170 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:24.739428 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6aa0892a-c6a0-44a7-a6d8-9f7cf4886170 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:24.740049 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6aa0892a-c6a0-44a7-a6d8-9f7cf4886170 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:24.740970 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6aa0892a-c6a0-44a7-a6d8-9f7cf4886170 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:24.741594 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6aa0892a-c6a0-44a7-a6d8-9f7cf4886170 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:24.742209 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6aa0892a-c6a0-44a7-a6d8-9f7cf4886170 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:24.787016 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-d7e138d0-dbab-4a4b-ad21-fdcf72619531 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "POST /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05/action" status: 202 len: 0 microversion: 2.20 time: 0.352926 Aug 10 11:35:24.794877 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 169/336] 10.222.0.62 () {62 vars in 1319 bytes} [Wed Aug 10 11:35:24 2022] POST /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05/action => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:35:24.800710 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-1b9e8e19-9893-46b0-96f9-ef491d771a02 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:24.803777 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-1b9e8e19-9893-46b0-96f9-ef491d771a02 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:24.809123 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1b9e8e19-9893-46b0-96f9-ef491d771a02 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:24.809875 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1b9e8e19-9893-46b0-96f9-ef491d771a02 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:24.810538 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1b9e8e19-9893-46b0-96f9-ef491d771a02 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:24.811249 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1b9e8e19-9893-46b0-96f9-ef491d771a02 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:24.811774 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1b9e8e19-9893-46b0-96f9-ef491d771a02 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:24.812433 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1b9e8e19-9893-46b0-96f9-ef491d771a02 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:24.831264 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:35:24.891307 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-6aa0892a-c6a0-44a7-a6d8-9f7cf4886170 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d35c64f3a748da9075622e08283aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8329fbf83b104200a04faaa9c454d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:24.899843 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-6aa0892a-c6a0-44a7-a6d8-9f7cf4886170 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] 10.222.0.62 "GET /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1" status: 200 len: 1319 microversion: 2.1 time: 0.173142 Aug 10 11:35:24.900466 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 168/337] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:24 2022] GET /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:35:25.001653 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-1b9e8e19-9893-46b0-96f9-ef491d771a02 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:25.010405 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-1b9e8e19-9893-46b0-96f9-ef491d771a02 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:25.011926 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-1b9e8e19-9893-46b0-96f9-ef491d771a02 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:25.013248 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-1b9e8e19-9893-46b0-96f9-ef491d771a02 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1750 microversion: 2.20 time: 0.217192 Aug 10 11:35:25.013813 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 170/338] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:35:24 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1750 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:35:25.921559 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-9e466b30-1e7a-4334-bd97-6f7a73316dba tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:25.922175 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-9e466b30-1e7a-4334-bd97-6f7a73316dba tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 95b0dee9-162e-4edc-98e5-a6d36ce71ec1] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:25.932748 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9e466b30-1e7a-4334-bd97-6f7a73316dba tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:25.933698 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9e466b30-1e7a-4334-bd97-6f7a73316dba tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:25.934098 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9e466b30-1e7a-4334-bd97-6f7a73316dba tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:25.934795 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9e466b30-1e7a-4334-bd97-6f7a73316dba tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:25.935247 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9e466b30-1e7a-4334-bd97-6f7a73316dba tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:25.935766 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9e466b30-1e7a-4334-bd97-6f7a73316dba tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:26.038350 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-7a4ac008-39ba-410d-acbf-ff8f37346bab tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:26.039033 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-7a4ac008-39ba-410d-acbf-ff8f37346bab tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:26.047303 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7a4ac008-39ba-410d-acbf-ff8f37346bab tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:26.048255 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7a4ac008-39ba-410d-acbf-ff8f37346bab tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:26.048767 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7a4ac008-39ba-410d-acbf-ff8f37346bab tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:26.050563 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7a4ac008-39ba-410d-acbf-ff8f37346bab tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:26.050563 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7a4ac008-39ba-410d-acbf-ff8f37346bab tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:26.050563 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7a4ac008-39ba-410d-acbf-ff8f37346bab tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:26.093641 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-9e466b30-1e7a-4334-bd97-6f7a73316dba tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d35c64f3a748da9075622e08283aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8329fbf83b104200a04faaa9c454d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:26.106886 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-9e466b30-1e7a-4334-bd97-6f7a73316dba tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] 10.222.0.62 "GET /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1" status: 200 len: 1319 microversion: 2.1 time: 0.189546 Aug 10 11:35:26.107833 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 169/339] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:25 2022] GET /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1 => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:26.208590 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-7a4ac008-39ba-410d-acbf-ff8f37346bab tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:26.218609 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-7a4ac008-39ba-410d-acbf-ff8f37346bab tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:26.220448 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-7a4ac008-39ba-410d-acbf-ff8f37346bab tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:26.222752 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-7a4ac008-39ba-410d-acbf-ff8f37346bab tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1750 microversion: 2.20 time: 0.189766 Aug 10 11:35:26.224353 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 171/340] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:35:26 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1750 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:35:27.135176 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-65bdd660-1aee-4291-ab80-12c0c0ebebf6 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:27.135885 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-65bdd660-1aee-4291-ab80-12c0c0ebebf6 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 95b0dee9-162e-4edc-98e5-a6d36ce71ec1] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:27.142820 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-65bdd660-1aee-4291-ab80-12c0c0ebebf6 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:27.143378 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-65bdd660-1aee-4291-ab80-12c0c0ebebf6 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:27.150435 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-65bdd660-1aee-4291-ab80-12c0c0ebebf6 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:27.150435 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-65bdd660-1aee-4291-ab80-12c0c0ebebf6 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:27.150435 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-65bdd660-1aee-4291-ab80-12c0c0ebebf6 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:27.150435 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-65bdd660-1aee-4291-ab80-12c0c0ebebf6 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:27.247413 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-a57bdc59-0679-4db9-8c19-99e62b772c66 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:27.248066 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-a57bdc59-0679-4db9-8c19-99e62b772c66 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:27.255434 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a57bdc59-0679-4db9-8c19-99e62b772c66 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:27.256182 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a57bdc59-0679-4db9-8c19-99e62b772c66 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:27.256632 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a57bdc59-0679-4db9-8c19-99e62b772c66 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:27.257640 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a57bdc59-0679-4db9-8c19-99e62b772c66 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:27.258108 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a57bdc59-0679-4db9-8c19-99e62b772c66 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:27.258541 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a57bdc59-0679-4db9-8c19-99e62b772c66 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:27.283270 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-65bdd660-1aee-4291-ab80-12c0c0ebebf6 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d35c64f3a748da9075622e08283aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8329fbf83b104200a04faaa9c454d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:27.291484 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-65bdd660-1aee-4291-ab80-12c0c0ebebf6 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] 10.222.0.62 "GET /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1" status: 200 len: 1319 microversion: 2.1 time: 0.160634 Aug 10 11:35:27.292086 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 170/341] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:27 2022] GET /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:27.392831 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-a57bdc59-0679-4db9-8c19-99e62b772c66 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:27.401960 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-a57bdc59-0679-4db9-8c19-99e62b772c66 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:27.403388 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-a57bdc59-0679-4db9-8c19-99e62b772c66 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:27.404662 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-a57bdc59-0679-4db9-8c19-99e62b772c66 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1752 microversion: 2.20 time: 0.161213 Aug 10 11:35:27.405229 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 172/342] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:35:27 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1752 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:35:27.896808 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-373de2da-ac0d-4c0e-aace-5f00139b279f req-6c941bcb-a873-4c28-a298-a833c5b92294 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95b0dee9-162e-4edc-98e5-a6d36ce71ec1", "name": "network-vif-plugged", "status": "completed", "tag": "484483b2-57e1-4178-9ceb-6fe32dbb0e0b"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:35:27.907652 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-373de2da-ac0d-4c0e-aace-5f00139b279f req-6c941bcb-a873-4c28-a298-a833c5b92294 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:27.908213 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-373de2da-ac0d-4c0e-aace-5f00139b279f req-6c941bcb-a873-4c28-a298-a833c5b92294 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:27.908720 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-373de2da-ac0d-4c0e-aace-5f00139b279f req-6c941bcb-a873-4c28-a298-a833c5b92294 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:27.920506 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-373de2da-ac0d-4c0e-aace-5f00139b279f req-6c941bcb-a873-4c28-a298-a833c5b92294 service nova] Creating event network-vif-plugged:484483b2-57e1-4178-9ceb-6fe32dbb0e0b for instance 95b0dee9-162e-4edc-98e5-a6d36ce71ec1 on hv-cinder-85272 Aug 10 11:35:27.925697 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-373de2da-ac0d-4c0e-aace-5f00139b279f req-6c941bcb-a873-4c28-a298-a833c5b92294 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033529 Aug 10 11:35:27.928104 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 171/343] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:35:28.314450 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-9cd92541-cb3f-4854-b698-cfa2e9d02c86 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:28.316336 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-9cd92541-cb3f-4854-b698-cfa2e9d02c86 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 95b0dee9-162e-4edc-98e5-a6d36ce71ec1] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:28.325499 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9cd92541-cb3f-4854-b698-cfa2e9d02c86 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:28.326294 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9cd92541-cb3f-4854-b698-cfa2e9d02c86 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:28.326996 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9cd92541-cb3f-4854-b698-cfa2e9d02c86 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:28.328456 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9cd92541-cb3f-4854-b698-cfa2e9d02c86 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:28.329189 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9cd92541-cb3f-4854-b698-cfa2e9d02c86 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:28.329783 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9cd92541-cb3f-4854-b698-cfa2e9d02c86 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:28.428863 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-7c09e496-a420-4f40-9590-ea7a981cdd97 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:28.429568 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-7c09e496-a420-4f40-9590-ea7a981cdd97 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:28.436275 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7c09e496-a420-4f40-9590-ea7a981cdd97 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:28.436822 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7c09e496-a420-4f40-9590-ea7a981cdd97 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:28.437452 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7c09e496-a420-4f40-9590-ea7a981cdd97 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:28.438237 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7c09e496-a420-4f40-9590-ea7a981cdd97 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:28.438979 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7c09e496-a420-4f40-9590-ea7a981cdd97 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:28.439563 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7c09e496-a420-4f40-9590-ea7a981cdd97 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:28.474922 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-9cd92541-cb3f-4854-b698-cfa2e9d02c86 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d35c64f3a748da9075622e08283aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8329fbf83b104200a04faaa9c454d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:28.482461 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-9cd92541-cb3f-4854-b698-cfa2e9d02c86 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] 10.222.0.62 "GET /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1" status: 200 len: 1319 microversion: 2.1 time: 0.173513 Aug 10 11:35:28.483430 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 173/344] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:28 2022] GET /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:28.576108 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-7c09e496-a420-4f40-9590-ea7a981cdd97 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:28.586372 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-7c09e496-a420-4f40-9590-ea7a981cdd97 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:28.587858 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-7c09e496-a420-4f40-9590-ea7a981cdd97 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:28.589076 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-7c09e496-a420-4f40-9590-ea7a981cdd97 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1808 microversion: 2.20 time: 0.165111 Aug 10 11:35:28.589628 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 172/345] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:35:28 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:35:29.502467 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-9a7c4f59-79a2-4ff1-93f8-aeb02f94749e tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:29.503209 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-9a7c4f59-79a2-4ff1-93f8-aeb02f94749e tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 95b0dee9-162e-4edc-98e5-a6d36ce71ec1] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:29.509642 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9a7c4f59-79a2-4ff1-93f8-aeb02f94749e tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:29.510205 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9a7c4f59-79a2-4ff1-93f8-aeb02f94749e tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:29.510709 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9a7c4f59-79a2-4ff1-93f8-aeb02f94749e tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:29.511473 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9a7c4f59-79a2-4ff1-93f8-aeb02f94749e tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:29.512021 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9a7c4f59-79a2-4ff1-93f8-aeb02f94749e tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:29.513289 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9a7c4f59-79a2-4ff1-93f8-aeb02f94749e tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:29.614070 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-dd048219-44b0-4169-a5a4-421bbe0b58a5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:29.614678 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-dd048219-44b0-4169-a5a4-421bbe0b58a5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:29.620789 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-dd048219-44b0-4169-a5a4-421bbe0b58a5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:29.621268 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-dd048219-44b0-4169-a5a4-421bbe0b58a5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:29.621699 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-dd048219-44b0-4169-a5a4-421bbe0b58a5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:29.622395 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-dd048219-44b0-4169-a5a4-421bbe0b58a5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:29.622835 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-dd048219-44b0-4169-a5a4-421bbe0b58a5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:29.623471 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-dd048219-44b0-4169-a5a4-421bbe0b58a5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:29.638798 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:35:29.725716 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-9a7c4f59-79a2-4ff1-93f8-aeb02f94749e tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d35c64f3a748da9075622e08283aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8329fbf83b104200a04faaa9c454d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:29.733228 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-9a7c4f59-79a2-4ff1-93f8-aeb02f94749e tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] 10.222.0.62 "GET /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1" status: 200 len: 1319 microversion: 2.1 time: 0.234511 Aug 10 11:35:29.736119 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 174/346] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:29 2022] GET /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1 => generated 1319 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:29.791951 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-dd048219-44b0-4169-a5a4-421bbe0b58a5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:29.820166 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-dd048219-44b0-4169-a5a4-421bbe0b58a5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:29.821796 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-dd048219-44b0-4169-a5a4-421bbe0b58a5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:29.823170 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-dd048219-44b0-4169-a5a4-421bbe0b58a5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1808 microversion: 2.20 time: 0.213663 Aug 10 11:35:29.823939 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 173/347] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:35:29 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1808 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:35:30.754523 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-d3156e07-8783-4b20-8576-38d3102ebd89 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:30.755141 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-d3156e07-8783-4b20-8576-38d3102ebd89 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 95b0dee9-162e-4edc-98e5-a6d36ce71ec1] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:30.765615 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d3156e07-8783-4b20-8576-38d3102ebd89 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:30.766116 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d3156e07-8783-4b20-8576-38d3102ebd89 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:30.766551 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d3156e07-8783-4b20-8576-38d3102ebd89 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:30.767263 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d3156e07-8783-4b20-8576-38d3102ebd89 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:30.767727 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d3156e07-8783-4b20-8576-38d3102ebd89 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:30.770633 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d3156e07-8783-4b20-8576-38d3102ebd89 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:30.847091 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-7433643d-ef31-44c0-bb3a-91132d079360 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:30.847921 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-7433643d-ef31-44c0-bb3a-91132d079360 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:30.856528 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7433643d-ef31-44c0-bb3a-91132d079360 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:30.857199 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7433643d-ef31-44c0-bb3a-91132d079360 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:30.857966 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7433643d-ef31-44c0-bb3a-91132d079360 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:30.858900 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7433643d-ef31-44c0-bb3a-91132d079360 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:30.859632 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7433643d-ef31-44c0-bb3a-91132d079360 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:30.860189 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7433643d-ef31-44c0-bb3a-91132d079360 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:30.902813 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-d3156e07-8783-4b20-8576-38d3102ebd89 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d35c64f3a748da9075622e08283aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8329fbf83b104200a04faaa9c454d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:30.911227 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-d3156e07-8783-4b20-8576-38d3102ebd89 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] 10.222.0.62 "GET /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1" status: 200 len: 1508 microversion: 2.1 time: 0.161147 Aug 10 11:35:30.912002 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 175/348] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:30 2022] GET /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1 => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:31.039897 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-7433643d-ef31-44c0-bb3a-91132d079360 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:31.054339 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-7433643d-ef31-44c0-bb3a-91132d079360 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:31.056006 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-7433643d-ef31-44c0-bb3a-91132d079360 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:31.057513 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-7433643d-ef31-44c0-bb3a-91132d079360 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1808 microversion: 2.20 time: 0.214479 Aug 10 11:35:31.064069 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 174/349] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:35:30 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1808 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:35:32.085597 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-07c90b12-3aa3-439c-907b-14898275a35b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:32.086930 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-07c90b12-3aa3-439c-907b-14898275a35b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:32.099692 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-07c90b12-3aa3-439c-907b-14898275a35b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:32.103092 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-07c90b12-3aa3-439c-907b-14898275a35b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:32.103763 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-07c90b12-3aa3-439c-907b-14898275a35b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:32.104519 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-07c90b12-3aa3-439c-907b-14898275a35b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:32.104978 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-07c90b12-3aa3-439c-907b-14898275a35b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:32.105407 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-07c90b12-3aa3-439c-907b-14898275a35b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:32.348975 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-07c90b12-3aa3-439c-907b-14898275a35b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:32.361999 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-07c90b12-3aa3-439c-907b-14898275a35b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:32.372220 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-07c90b12-3aa3-439c-907b-14898275a35b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:32.372220 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-07c90b12-3aa3-439c-907b-14898275a35b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1808 microversion: 2.20 time: 0.292338 Aug 10 11:35:32.392156 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 176/350] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:35:32 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1808 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:35:33.400691 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-9ff13a68-34fb-4cb6-b1e7-90ab88ca400c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:33.402424 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-9ff13a68-34fb-4cb6-b1e7-90ab88ca400c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:33.414601 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9ff13a68-34fb-4cb6-b1e7-90ab88ca400c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:33.415449 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9ff13a68-34fb-4cb6-b1e7-90ab88ca400c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:33.416154 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9ff13a68-34fb-4cb6-b1e7-90ab88ca400c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:33.421361 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9ff13a68-34fb-4cb6-b1e7-90ab88ca400c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:33.422633 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9ff13a68-34fb-4cb6-b1e7-90ab88ca400c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:33.423171 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9ff13a68-34fb-4cb6-b1e7-90ab88ca400c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:33.606874 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-9ff13a68-34fb-4cb6-b1e7-90ab88ca400c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:33.649836 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-9ff13a68-34fb-4cb6-b1e7-90ab88ca400c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:33.654089 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-9ff13a68-34fb-4cb6-b1e7-90ab88ca400c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:33.655340 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-9ff13a68-34fb-4cb6-b1e7-90ab88ca400c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1808 microversion: 2.20 time: 0.258591 Aug 10 11:35:33.661348 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 175/351] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:35:33 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1808 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:35:34.691672 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-29913333-c167-4494-90ab-87028c0dd0e0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:34.693090 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-29913333-c167-4494-90ab-87028c0dd0e0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:34.701192 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-29913333-c167-4494-90ab-87028c0dd0e0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:34.702103 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-29913333-c167-4494-90ab-87028c0dd0e0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:34.702757 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-29913333-c167-4494-90ab-87028c0dd0e0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:34.703746 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-29913333-c167-4494-90ab-87028c0dd0e0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:34.704442 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-29913333-c167-4494-90ab-87028c0dd0e0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:34.705103 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-29913333-c167-4494-90ab-87028c0dd0e0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:35.146123 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-29913333-c167-4494-90ab-87028c0dd0e0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:35.154482 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-29913333-c167-4494-90ab-87028c0dd0e0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:35.156046 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-29913333-c167-4494-90ab-87028c0dd0e0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:35.157215 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-29913333-c167-4494-90ab-87028c0dd0e0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1808 microversion: 2.20 time: 0.470640 Aug 10 11:35:35.157779 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 177/352] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:35:34 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1808 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:35:36.187245 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-ee20d759-87f3-4bde-b095-2a174f1f1fe2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:36.187847 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-ee20d759-87f3-4bde-b095-2a174f1f1fe2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:36.195343 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ee20d759-87f3-4bde-b095-2a174f1f1fe2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:36.195821 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ee20d759-87f3-4bde-b095-2a174f1f1fe2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:36.196278 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ee20d759-87f3-4bde-b095-2a174f1f1fe2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:36.196977 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ee20d759-87f3-4bde-b095-2a174f1f1fe2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:36.197427 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ee20d759-87f3-4bde-b095-2a174f1f1fe2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:36.197849 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ee20d759-87f3-4bde-b095-2a174f1f1fe2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:36.356579 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-ee20d759-87f3-4bde-b095-2a174f1f1fe2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:36.366660 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-ee20d759-87f3-4bde-b095-2a174f1f1fe2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:36.368496 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-ee20d759-87f3-4bde-b095-2a174f1f1fe2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:36.369725 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-ee20d759-87f3-4bde-b095-2a174f1f1fe2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1808 microversion: 2.20 time: 0.192904 Aug 10 11:35:36.370288 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 176/353] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:35:36 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1808 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:35:36.820921 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-e81775f1-acae-43b2-95a3-001ec73b9239 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-924900976", "imageRef": "99bbc441-5102-4a51-a496-cfbffeb3033a", "flavorRef": "452"}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:35:37.398041 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-b92e5479-ab7d-4cde-bf2f-b23d26558f96 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:37.398708 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-b92e5479-ab7d-4cde-bf2f-b23d26558f96 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:37.405863 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b92e5479-ab7d-4cde-bf2f-b23d26558f96 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:37.407036 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b92e5479-ab7d-4cde-bf2f-b23d26558f96 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:37.407657 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b92e5479-ab7d-4cde-bf2f-b23d26558f96 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:37.408563 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b92e5479-ab7d-4cde-bf2f-b23d26558f96 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:37.409675 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b92e5479-ab7d-4cde-bf2f-b23d26558f96 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:37.410257 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b92e5479-ab7d-4cde-bf2f-b23d26558f96 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:37.783797 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b92e5479-ab7d-4cde-bf2f-b23d26558f96 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:37.798532 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b92e5479-ab7d-4cde-bf2f-b23d26558f96 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:37.802725 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b92e5479-ab7d-4cde-bf2f-b23d26558f96 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:37.804732 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-b92e5479-ab7d-4cde-bf2f-b23d26558f96 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1808 microversion: 2.20 time: 0.411357 Aug 10 11:35:37.806475 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 177/354] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:35:37 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1808 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:35:38.830066 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-ae8cd90f-88be-4671-b818-5e2aba061c14 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:38.830834 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-ae8cd90f-88be-4671-b818-5e2aba061c14 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:38.838046 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ae8cd90f-88be-4671-b818-5e2aba061c14 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:38.838530 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ae8cd90f-88be-4671-b818-5e2aba061c14 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:38.838968 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ae8cd90f-88be-4671-b818-5e2aba061c14 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:38.839661 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ae8cd90f-88be-4671-b818-5e2aba061c14 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:38.840153 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ae8cd90f-88be-4671-b818-5e2aba061c14 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:38.840583 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ae8cd90f-88be-4671-b818-5e2aba061c14 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:38.981807 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-ae8cd90f-88be-4671-b818-5e2aba061c14 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:38.992360 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-ae8cd90f-88be-4671-b818-5e2aba061c14 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:38.993893 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-ae8cd90f-88be-4671-b818-5e2aba061c14 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:38.995099 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-ae8cd90f-88be-4671-b818-5e2aba061c14 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1808 microversion: 2.20 time: 0.169124 Aug 10 11:35:38.995656 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 178/355] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:35:38 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:35:40.026012 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-e8f01cd1-43cf-4b72-a8e9-b5ac791ee5b5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:40.027380 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-e8f01cd1-43cf-4b72-a8e9-b5ac791ee5b5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:40.034875 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e8f01cd1-43cf-4b72-a8e9-b5ac791ee5b5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:40.035369 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e8f01cd1-43cf-4b72-a8e9-b5ac791ee5b5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:40.035806 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e8f01cd1-43cf-4b72-a8e9-b5ac791ee5b5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:40.036535 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e8f01cd1-43cf-4b72-a8e9-b5ac791ee5b5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:40.036996 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e8f01cd1-43cf-4b72-a8e9-b5ac791ee5b5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:40.037427 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e8f01cd1-43cf-4b72-a8e9-b5ac791ee5b5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:40.214728 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-e8f01cd1-43cf-4b72-a8e9-b5ac791ee5b5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:40.225005 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-e8f01cd1-43cf-4b72-a8e9-b5ac791ee5b5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:40.226926 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-e8f01cd1-43cf-4b72-a8e9-b5ac791ee5b5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:40.228159 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-e8f01cd1-43cf-4b72-a8e9-b5ac791ee5b5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1808 microversion: 2.20 time: 0.212220 Aug 10 11:35:40.228725 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 179/356] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:35:40 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1808 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:35:41.250601 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-c5a9f9bf-d6f8-443b-9902-9a37663d2e6e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:41.251311 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-c5a9f9bf-d6f8-443b-9902-9a37663d2e6e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:41.258416 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c5a9f9bf-d6f8-443b-9902-9a37663d2e6e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:41.258971 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c5a9f9bf-d6f8-443b-9902-9a37663d2e6e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:41.259411 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c5a9f9bf-d6f8-443b-9902-9a37663d2e6e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:41.260134 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c5a9f9bf-d6f8-443b-9902-9a37663d2e6e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:41.260585 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c5a9f9bf-d6f8-443b-9902-9a37663d2e6e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:41.261007 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c5a9f9bf-d6f8-443b-9902-9a37663d2e6e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:41.432208 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c5a9f9bf-d6f8-443b-9902-9a37663d2e6e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:41.441935 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c5a9f9bf-d6f8-443b-9902-9a37663d2e6e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:41.443616 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c5a9f9bf-d6f8-443b-9902-9a37663d2e6e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:41.445008 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-c5a9f9bf-d6f8-443b-9902-9a37663d2e6e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1808 microversion: 2.20 time: 0.198254 Aug 10 11:35:41.446329 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 180/357] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:35:41 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1808 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:35:42.467491 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-f84307f3-32c3-48a6-a117-0f4562b28613 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:42.468170 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-f84307f3-32c3-48a6-a117-0f4562b28613 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:42.475401 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f84307f3-32c3-48a6-a117-0f4562b28613 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:42.476157 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f84307f3-32c3-48a6-a117-0f4562b28613 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:42.476777 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f84307f3-32c3-48a6-a117-0f4562b28613 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:42.477640 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f84307f3-32c3-48a6-a117-0f4562b28613 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:42.478243 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f84307f3-32c3-48a6-a117-0f4562b28613 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:42.478831 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f84307f3-32c3-48a6-a117-0f4562b28613 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:42.644954 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-f84307f3-32c3-48a6-a117-0f4562b28613 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:42.655094 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-f84307f3-32c3-48a6-a117-0f4562b28613 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:42.657052 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-f84307f3-32c3-48a6-a117-0f4562b28613 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:42.658695 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-f84307f3-32c3-48a6-a117-0f4562b28613 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1808 microversion: 2.20 time: 0.195101 Aug 10 11:35:42.659794 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 181/358] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:35:42 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1808 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:35:42.678864 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.network.neutron [None req-e81775f1-acae-43b2-95a3-001ec73b9239 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] validate_networks() for None {{(pid=124683) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:35:42.982046 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-e81775f1-acae-43b2-95a3-001ec73b9239 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Flavor limits 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:35:42.982700 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-e81775f1-acae-43b2-95a3-001ec73b9239 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Image limits 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:35:42.983321 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-e81775f1-acae-43b2-95a3-001ec73b9239 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Flavor pref 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:35:42.983913 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-e81775f1-acae-43b2-95a3-001ec73b9239 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Image pref 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:35:42.984673 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-e81775f1-acae-43b2-95a3-001ec73b9239 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:35:42.995431 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e81775f1-acae-43b2-95a3-001ec73b9239 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:42.996178 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e81775f1-acae-43b2-95a3-001ec73b9239 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:42.996902 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e81775f1-acae-43b2-95a3-001ec73b9239 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:42.998086 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e81775f1-acae-43b2-95a3-001ec73b9239 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:42.998781 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e81775f1-acae-43b2-95a3-001ec73b9239 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:42.999393 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e81775f1-acae-43b2-95a3-001ec73b9239 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:43.032244 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-e81775f1-acae-43b2-95a3-001ec73b9239 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Getting quotas for project 112c1533b3ec486199f4e8e52304d19b. Resources: {'ram', 'instances', 'cores'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:35:43.038249 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-e81775f1-acae-43b2-95a3-001ec73b9239 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Getting quotas for user 95b0732607644878ac97193850006d07 and project 112c1533b3ec486199f4e8e52304d19b. Resources: {'ram', 'instances', 'cores'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:35:43.064844 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-e81775f1-acae-43b2-95a3-001ec73b9239 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Going to run 1 instances... {{(pid=124683) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:35:43.068015 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-e81775f1-acae-43b2-95a3-001ec73b9239 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] [instance: 82e432fe-fd3a-4e41-b80b-2ba456296e22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99bbc441-5102-4a51-a496-cfbffeb3033a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124683) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:35:43.226631 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-e81775f1-acae-43b2-95a3-001ec73b9239 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.409418 Aug 10 11:35:43.227386 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 178/359] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Aug 10 11:35:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 6411 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 11:35:43.239649 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-a1a35032-7456-45c0-93a8-e31fcb2803a6 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:43.240341 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-a1a35032-7456-45c0-93a8-e31fcb2803a6 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] [instance: 82e432fe-fd3a-4e41-b80b-2ba456296e22] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:43.333984 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-a1a35032-7456-45c0-93a8-e31fcb2803a6 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b0732607644878ac97193850006d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112c1533b3ec486199f4e8e52304d19b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:43.343999 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-a1a35032-7456-45c0-93a8-e31fcb2803a6 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] 10.222.0.62 "GET /compute/v2.1/servers/82e432fe-fd3a-4e41-b80b-2ba456296e22" status: 200 len: 1214 microversion: 2.1 time: 0.108864 Aug 10 11:35:43.344596 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 182/360] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:43 2022] GET /compute/v2.1/servers/82e432fe-fd3a-4e41-b80b-2ba456296e22 => generated 1214 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:43.682461 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-154a7ebc-39c0-4a0c-9779-d774ea5f9eb7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:43.683085 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-154a7ebc-39c0-4a0c-9779-d774ea5f9eb7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:43.690937 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-154a7ebc-39c0-4a0c-9779-d774ea5f9eb7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:43.692457 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-154a7ebc-39c0-4a0c-9779-d774ea5f9eb7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:43.692999 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-154a7ebc-39c0-4a0c-9779-d774ea5f9eb7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:43.693823 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-154a7ebc-39c0-4a0c-9779-d774ea5f9eb7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:43.694374 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-154a7ebc-39c0-4a0c-9779-d774ea5f9eb7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:43.694872 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-154a7ebc-39c0-4a0c-9779-d774ea5f9eb7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:43.837811 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-154a7ebc-39c0-4a0c-9779-d774ea5f9eb7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:43.846667 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-154a7ebc-39c0-4a0c-9779-d774ea5f9eb7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:43.848259 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-154a7ebc-39c0-4a0c-9779-d774ea5f9eb7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:43.849413 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-154a7ebc-39c0-4a0c-9779-d774ea5f9eb7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1808 microversion: 2.20 time: 0.171563 Aug 10 11:35:43.849969 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 179/361] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:35:43 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:35:44.375537 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-aaae038b-a94f-448c-8424-fe59305598c6 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:44.377081 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-aaae038b-a94f-448c-8424-fe59305598c6 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] [instance: 82e432fe-fd3a-4e41-b80b-2ba456296e22] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:44.462235 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-aaae038b-a94f-448c-8424-fe59305598c6 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b0732607644878ac97193850006d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112c1533b3ec486199f4e8e52304d19b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:44.471838 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-aaae038b-a94f-448c-8424-fe59305598c6 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] 10.222.0.62 "GET /compute/v2.1/servers/82e432fe-fd3a-4e41-b80b-2ba456296e22" status: 200 len: 1214 microversion: 2.1 time: 0.110989 Aug 10 11:35:44.473164 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 183/362] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:44 2022] GET /compute/v2.1/servers/82e432fe-fd3a-4e41-b80b-2ba456296e22 => generated 1214 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:44.873067 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-47372540-2abe-4aa6-b9f4-21a98b77d472 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:44.874935 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-47372540-2abe-4aa6-b9f4-21a98b77d472 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:44.889582 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:35:44.894640 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-47372540-2abe-4aa6-b9f4-21a98b77d472 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:44.897931 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-47372540-2abe-4aa6-b9f4-21a98b77d472 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:44.898790 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-47372540-2abe-4aa6-b9f4-21a98b77d472 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:44.899921 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-47372540-2abe-4aa6-b9f4-21a98b77d472 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:44.900638 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-47372540-2abe-4aa6-b9f4-21a98b77d472 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:44.901290 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-47372540-2abe-4aa6-b9f4-21a98b77d472 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:45.215322 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-47372540-2abe-4aa6-b9f4-21a98b77d472 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:45.234774 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-47372540-2abe-4aa6-b9f4-21a98b77d472 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:45.236561 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-47372540-2abe-4aa6-b9f4-21a98b77d472 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:45.240580 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-47372540-2abe-4aa6-b9f4-21a98b77d472 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1808 microversion: 2.20 time: 0.371846 Aug 10 11:35:45.241265 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 180/363] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:35:44 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1808 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:35:45.498048 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-0b4f693d-fc87-4949-9c05-c09e08263266 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:45.498700 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-0b4f693d-fc87-4949-9c05-c09e08263266 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] [instance: 82e432fe-fd3a-4e41-b80b-2ba456296e22] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:45.502945 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=64 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:35:45.505781 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0b4f693d-fc87-4949-9c05-c09e08263266 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:45.506277 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0b4f693d-fc87-4949-9c05-c09e08263266 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:45.506724 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0b4f693d-fc87-4949-9c05-c09e08263266 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:45.507429 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0b4f693d-fc87-4949-9c05-c09e08263266 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:45.508093 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0b4f693d-fc87-4949-9c05-c09e08263266 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:45.508684 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0b4f693d-fc87-4949-9c05-c09e08263266 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:45.577852 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-0b4f693d-fc87-4949-9c05-c09e08263266 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b0732607644878ac97193850006d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112c1533b3ec486199f4e8e52304d19b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:45.590121 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-0b4f693d-fc87-4949-9c05-c09e08263266 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] 10.222.0.62 "GET /compute/v2.1/servers/82e432fe-fd3a-4e41-b80b-2ba456296e22" status: 200 len: 1266 microversion: 2.1 time: 0.096171 Aug 10 11:35:45.592746 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 184/364] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:45 2022] GET /compute/v2.1/servers/82e432fe-fd3a-4e41-b80b-2ba456296e22 => generated 1266 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:46.266252 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-7b15a45a-fa6b-4ef1-810d-c891bba8b6b1 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:46.266958 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-7b15a45a-fa6b-4ef1-810d-c891bba8b6b1 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:46.280705 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7b15a45a-fa6b-4ef1-810d-c891bba8b6b1 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:46.281521 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7b15a45a-fa6b-4ef1-810d-c891bba8b6b1 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:46.282172 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7b15a45a-fa6b-4ef1-810d-c891bba8b6b1 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:46.283087 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7b15a45a-fa6b-4ef1-810d-c891bba8b6b1 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:46.284710 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7b15a45a-fa6b-4ef1-810d-c891bba8b6b1 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:46.287259 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7b15a45a-fa6b-4ef1-810d-c891bba8b6b1 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:46.613998 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-249d158b-cbd5-4b4b-8932-0ed934b33606 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:46.614736 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-249d158b-cbd5-4b4b-8932-0ed934b33606 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] [instance: 82e432fe-fd3a-4e41-b80b-2ba456296e22] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:46.621910 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-249d158b-cbd5-4b4b-8932-0ed934b33606 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:46.622404 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-249d158b-cbd5-4b4b-8932-0ed934b33606 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:46.622846 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-249d158b-cbd5-4b4b-8932-0ed934b33606 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:46.623554 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-249d158b-cbd5-4b4b-8932-0ed934b33606 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:46.624084 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-249d158b-cbd5-4b4b-8932-0ed934b33606 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:46.624514 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-249d158b-cbd5-4b4b-8932-0ed934b33606 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:46.722344 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-249d158b-cbd5-4b4b-8932-0ed934b33606 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b0732607644878ac97193850006d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112c1533b3ec486199f4e8e52304d19b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:46.731130 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-249d158b-cbd5-4b4b-8932-0ed934b33606 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] 10.222.0.62 "GET /compute/v2.1/servers/82e432fe-fd3a-4e41-b80b-2ba456296e22" status: 200 len: 1272 microversion: 2.1 time: 0.121011 Aug 10 11:35:46.731721 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 185/365] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:46 2022] GET /compute/v2.1/servers/82e432fe-fd3a-4e41-b80b-2ba456296e22 => generated 1272 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:35:46.950431 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-7b15a45a-fa6b-4ef1-810d-c891bba8b6b1 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:46.961372 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-7b15a45a-fa6b-4ef1-810d-c891bba8b6b1 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:46.964219 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-7b15a45a-fa6b-4ef1-810d-c891bba8b6b1 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:46.965460 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-7b15a45a-fa6b-4ef1-810d-c891bba8b6b1 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1808 microversion: 2.20 time: 0.706596 Aug 10 11:35:46.966655 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 181/366] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:35:46 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1808 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:35:47.756937 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-883246ff-eb60-47ad-8511-808247af876b tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:47.757844 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-883246ff-eb60-47ad-8511-808247af876b tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] [instance: 82e432fe-fd3a-4e41-b80b-2ba456296e22] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:47.767679 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-883246ff-eb60-47ad-8511-808247af876b tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:47.768797 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-883246ff-eb60-47ad-8511-808247af876b tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:47.769362 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-883246ff-eb60-47ad-8511-808247af876b tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:47.770260 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-883246ff-eb60-47ad-8511-808247af876b tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:47.770723 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-883246ff-eb60-47ad-8511-808247af876b tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:47.771548 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-883246ff-eb60-47ad-8511-808247af876b tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:47.845719 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-883246ff-eb60-47ad-8511-808247af876b tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b0732607644878ac97193850006d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112c1533b3ec486199f4e8e52304d19b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:47.853733 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-883246ff-eb60-47ad-8511-808247af876b tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] 10.222.0.62 "GET /compute/v2.1/servers/82e432fe-fd3a-4e41-b80b-2ba456296e22" status: 200 len: 1272 microversion: 2.1 time: 0.104618 Aug 10 11:35:47.854300 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 186/367] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:47 2022] GET /compute/v2.1/servers/82e432fe-fd3a-4e41-b80b-2ba456296e22 => generated 1272 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:47.990585 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-ac17b311-0c8a-4f1a-a087-c17db1d200c8 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:47.991825 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-ac17b311-0c8a-4f1a-a087-c17db1d200c8 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:48.004150 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ac17b311-0c8a-4f1a-a087-c17db1d200c8 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:48.004953 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ac17b311-0c8a-4f1a-a087-c17db1d200c8 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:48.005798 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ac17b311-0c8a-4f1a-a087-c17db1d200c8 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:48.007917 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ac17b311-0c8a-4f1a-a087-c17db1d200c8 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:48.008670 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ac17b311-0c8a-4f1a-a087-c17db1d200c8 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:48.016085 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ac17b311-0c8a-4f1a-a087-c17db1d200c8 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:48.199703 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-ac17b311-0c8a-4f1a-a087-c17db1d200c8 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:48.222914 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-ac17b311-0c8a-4f1a-a087-c17db1d200c8 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:48.224467 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-ac17b311-0c8a-4f1a-a087-c17db1d200c8 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:48.225717 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-ac17b311-0c8a-4f1a-a087-c17db1d200c8 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1808 microversion: 2.20 time: 0.240404 Aug 10 11:35:48.229120 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 182/368] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:35:47 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1808 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:35:48.874927 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-89b27603-8480-4c70-9bbf-6b551592211b tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:48.876887 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-89b27603-8480-4c70-9bbf-6b551592211b tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] [instance: 82e432fe-fd3a-4e41-b80b-2ba456296e22] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:48.883115 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-89b27603-8480-4c70-9bbf-6b551592211b tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:48.883671 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-89b27603-8480-4c70-9bbf-6b551592211b tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:48.884368 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-89b27603-8480-4c70-9bbf-6b551592211b tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:48.885122 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-89b27603-8480-4c70-9bbf-6b551592211b tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:48.885979 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-89b27603-8480-4c70-9bbf-6b551592211b tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:48.886471 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-89b27603-8480-4c70-9bbf-6b551592211b tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:49.005980 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-13ecfb63-7d3d-4d3f-89de-5aef6345438a req-4d5f5633-7390-4c23-8589-bcf9bce49a95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82e432fe-fd3a-4e41-b80b-2ba456296e22", "tag": "861ae073-f7b0-484f-8a9a-031e0b047b69"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:35:49.021928 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-13ecfb63-7d3d-4d3f-89de-5aef6345438a req-4d5f5633-7390-4c23-8589-bcf9bce49a95 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:49.022658 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-13ecfb63-7d3d-4d3f-89de-5aef6345438a req-4d5f5633-7390-4c23-8589-bcf9bce49a95 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:49.023295 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-13ecfb63-7d3d-4d3f-89de-5aef6345438a req-4d5f5633-7390-4c23-8589-bcf9bce49a95 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:49.038320 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-13ecfb63-7d3d-4d3f-89de-5aef6345438a req-4d5f5633-7390-4c23-8589-bcf9bce49a95 service nova] Creating event network-changed:861ae073-f7b0-484f-8a9a-031e0b047b69 for instance 82e432fe-fd3a-4e41-b80b-2ba456296e22 on hv-cinder-85272 Aug 10 11:35:49.046814 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-13ecfb63-7d3d-4d3f-89de-5aef6345438a req-4d5f5633-7390-4c23-8589-bcf9bce49a95 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044714 Aug 10 11:35:49.048173 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 183/369] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:35:49.091252 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-89b27603-8480-4c70-9bbf-6b551592211b tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b0732607644878ac97193850006d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112c1533b3ec486199f4e8e52304d19b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:49.101704 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-89b27603-8480-4c70-9bbf-6b551592211b tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] 10.222.0.62 "GET /compute/v2.1/servers/82e432fe-fd3a-4e41-b80b-2ba456296e22" status: 200 len: 1314 microversion: 2.1 time: 0.230752 Aug 10 11:35:49.103337 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 187/370] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:48 2022] GET /compute/v2.1/servers/82e432fe-fd3a-4e41-b80b-2ba456296e22 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:49.257877 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-ed5d8cdb-bb99-45bd-b183-75d935042cf2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:49.259636 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-ed5d8cdb-bb99-45bd-b183-75d935042cf2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:49.267068 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ed5d8cdb-bb99-45bd-b183-75d935042cf2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:49.269918 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ed5d8cdb-bb99-45bd-b183-75d935042cf2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:49.271148 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ed5d8cdb-bb99-45bd-b183-75d935042cf2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:49.272240 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ed5d8cdb-bb99-45bd-b183-75d935042cf2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:49.272852 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ed5d8cdb-bb99-45bd-b183-75d935042cf2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:49.273500 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ed5d8cdb-bb99-45bd-b183-75d935042cf2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:49.421786 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-ed5d8cdb-bb99-45bd-b183-75d935042cf2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:49.433902 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-ed5d8cdb-bb99-45bd-b183-75d935042cf2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:49.433902 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-ed5d8cdb-bb99-45bd-b183-75d935042cf2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:49.435312 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-ed5d8cdb-bb99-45bd-b183-75d935042cf2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1808 microversion: 2.20 time: 0.184658 Aug 10 11:35:49.436042 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 184/371] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:35:49 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:35:49.958748 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-03739509-e09b-4c51-85e5-665c085d1627 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f6c3510-1905-4c98-9024-b7708066068d", "device": "/dev/sdb"}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:35:49.965749 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-03739509-e09b-4c51-85e5-665c085d1627 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 95b0dee9-162e-4edc-98e5-a6d36ce71ec1] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:49.973084 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-03739509-e09b-4c51-85e5-665c085d1627 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:49.973799 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-03739509-e09b-4c51-85e5-665c085d1627 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:49.974385 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-03739509-e09b-4c51-85e5-665c085d1627 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:49.975257 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-03739509-e09b-4c51-85e5-665c085d1627 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:49.975846 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-03739509-e09b-4c51-85e5-665c085d1627 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:49.976435 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-03739509-e09b-4c51-85e5-665c085d1627 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:50.123029 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-4930df5c-7300-49d7-8863-2d9ab3547c38 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:50.127129 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-4930df5c-7300-49d7-8863-2d9ab3547c38 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] [instance: 82e432fe-fd3a-4e41-b80b-2ba456296e22] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:50.136816 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4930df5c-7300-49d7-8863-2d9ab3547c38 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:50.137998 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4930df5c-7300-49d7-8863-2d9ab3547c38 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:50.139024 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4930df5c-7300-49d7-8863-2d9ab3547c38 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:50.140040 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4930df5c-7300-49d7-8863-2d9ab3547c38 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:50.140783 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4930df5c-7300-49d7-8863-2d9ab3547c38 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:50.141286 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4930df5c-7300-49d7-8863-2d9ab3547c38 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:50.438364 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-4930df5c-7300-49d7-8863-2d9ab3547c38 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b0732607644878ac97193850006d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112c1533b3ec486199f4e8e52304d19b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:50.452438 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-4930df5c-7300-49d7-8863-2d9ab3547c38 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] 10.222.0.62 "GET /compute/v2.1/servers/82e432fe-fd3a-4e41-b80b-2ba456296e22" status: 200 len: 1314 microversion: 2.1 time: 0.328105 Aug 10 11:35:50.452438 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 185/372] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:50 2022] GET /compute/v2.1/servers/82e432fe-fd3a-4e41-b80b-2ba456296e22 => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:35:50.463610 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-41781ca5-cb00-479f-abf2-9ac5b99a1875 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:50.464720 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-41781ca5-cb00-479f-abf2-9ac5b99a1875 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:50.477227 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-41781ca5-cb00-479f-abf2-9ac5b99a1875 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:50.481254 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-41781ca5-cb00-479f-abf2-9ac5b99a1875 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:50.482855 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-41781ca5-cb00-479f-abf2-9ac5b99a1875 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:50.483818 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-41781ca5-cb00-479f-abf2-9ac5b99a1875 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:50.485453 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-41781ca5-cb00-479f-abf2-9ac5b99a1875 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:50.485924 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-41781ca5-cb00-479f-abf2-9ac5b99a1875 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:50.796226 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-03739509-e09b-4c51-85e5-665c085d1627 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] 10.222.0.62 "POST /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.842742 Aug 10 11:35:50.798601 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 188/373] 10.222.0.62 () {60 vars in 1323 bytes} [Wed Aug 10 11:35:49 2022] POST /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1/os-volume_attachments => generated 194 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:35:50.805638 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-41781ca5-cb00-479f-abf2-9ac5b99a1875 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:50.826346 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-41781ca5-cb00-479f-abf2-9ac5b99a1875 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:50.830118 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-41781ca5-cb00-479f-abf2-9ac5b99a1875 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:50.834447 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-41781ca5-cb00-479f-abf2-9ac5b99a1875 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1808 microversion: 2.20 time: 0.377463 Aug 10 11:35:50.836812 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 186/374] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:35:50 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1808 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:35:51.469712 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-a3a91b4c-e6a5-4f75-b39e-036ebd27d4ed tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:51.470461 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-a3a91b4c-e6a5-4f75-b39e-036ebd27d4ed tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] [instance: 82e432fe-fd3a-4e41-b80b-2ba456296e22] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:51.479643 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a3a91b4c-e6a5-4f75-b39e-036ebd27d4ed tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:51.485448 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a3a91b4c-e6a5-4f75-b39e-036ebd27d4ed tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:51.485972 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a3a91b4c-e6a5-4f75-b39e-036ebd27d4ed tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:51.486919 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a3a91b4c-e6a5-4f75-b39e-036ebd27d4ed tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:51.488217 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a3a91b4c-e6a5-4f75-b39e-036ebd27d4ed tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:51.488723 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a3a91b4c-e6a5-4f75-b39e-036ebd27d4ed tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:51.769636 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-a3a91b4c-e6a5-4f75-b39e-036ebd27d4ed tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b0732607644878ac97193850006d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112c1533b3ec486199f4e8e52304d19b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:51.777419 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-a3a91b4c-e6a5-4f75-b39e-036ebd27d4ed tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] 10.222.0.62 "GET /compute/v2.1/servers/82e432fe-fd3a-4e41-b80b-2ba456296e22" status: 200 len: 1314 microversion: 2.1 time: 0.312104 Aug 10 11:35:51.778163 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 189/375] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:51 2022] GET /compute/v2.1/servers/82e432fe-fd3a-4e41-b80b-2ba456296e22 => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:51.859002 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-fda0ae85-3d67-4a8d-a4c7-30483f3938e0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:51.859625 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-fda0ae85-3d67-4a8d-a4c7-30483f3938e0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:51.866303 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fda0ae85-3d67-4a8d-a4c7-30483f3938e0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:51.866798 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fda0ae85-3d67-4a8d-a4c7-30483f3938e0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:51.867237 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fda0ae85-3d67-4a8d-a4c7-30483f3938e0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:51.867933 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fda0ae85-3d67-4a8d-a4c7-30483f3938e0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:51.868464 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fda0ae85-3d67-4a8d-a4c7-30483f3938e0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:51.869061 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fda0ae85-3d67-4a8d-a4c7-30483f3938e0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:52.059461 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-fda0ae85-3d67-4a8d-a4c7-30483f3938e0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:52.069263 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-fda0ae85-3d67-4a8d-a4c7-30483f3938e0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:52.084286 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-fda0ae85-3d67-4a8d-a4c7-30483f3938e0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:52.087326 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-fda0ae85-3d67-4a8d-a4c7-30483f3938e0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1808 microversion: 2.20 time: 0.232874 Aug 10 11:35:52.089695 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 187/376] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:35:51 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1808 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:35:52.798893 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-1e143477-35c6-4ada-be98-e95a2b7f4087 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:52.800200 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-1e143477-35c6-4ada-be98-e95a2b7f4087 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] [instance: 82e432fe-fd3a-4e41-b80b-2ba456296e22] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:52.806664 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1e143477-35c6-4ada-be98-e95a2b7f4087 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:52.807160 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1e143477-35c6-4ada-be98-e95a2b7f4087 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:52.807593 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1e143477-35c6-4ada-be98-e95a2b7f4087 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:52.808325 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1e143477-35c6-4ada-be98-e95a2b7f4087 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:52.808783 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1e143477-35c6-4ada-be98-e95a2b7f4087 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:52.809209 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1e143477-35c6-4ada-be98-e95a2b7f4087 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:53.069764 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-1e143477-35c6-4ada-be98-e95a2b7f4087 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b0732607644878ac97193850006d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112c1533b3ec486199f4e8e52304d19b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:53.073304 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:35:53.079544 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-1e143477-35c6-4ada-be98-e95a2b7f4087 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] 10.222.0.62 "GET /compute/v2.1/servers/82e432fe-fd3a-4e41-b80b-2ba456296e22" status: 200 len: 1314 microversion: 2.1 time: 0.284456 Aug 10 11:35:53.080329 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 190/377] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:52 2022] GET /compute/v2.1/servers/82e432fe-fd3a-4e41-b80b-2ba456296e22 => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:53.125417 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-91bff548-f94f-42aa-89c3-4c3441e70c28 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:53.126795 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-91bff548-f94f-42aa-89c3-4c3441e70c28 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:53.135990 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=2 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:35:53.145602 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=6 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:35:53.156562 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-91bff548-f94f-42aa-89c3-4c3441e70c28 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:53.157431 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-91bff548-f94f-42aa-89c3-4c3441e70c28 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:53.158068 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-91bff548-f94f-42aa-89c3-4c3441e70c28 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:53.159165 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-91bff548-f94f-42aa-89c3-4c3441e70c28 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:53.160200 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-91bff548-f94f-42aa-89c3-4c3441e70c28 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:53.160829 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-91bff548-f94f-42aa-89c3-4c3441e70c28 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:53.199766 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=100 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:35:53.334096 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-91bff548-f94f-42aa-89c3-4c3441e70c28 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:53.342770 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-91bff548-f94f-42aa-89c3-4c3441e70c28 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:53.344578 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-91bff548-f94f-42aa-89c3-4c3441e70c28 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:53.346566 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-91bff548-f94f-42aa-89c3-4c3441e70c28 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1808 microversion: 2.20 time: 0.235615 Aug 10 11:35:53.360630 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 188/378] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:35:53 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1808 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:35:54.105538 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-f8575f3b-2287-43ba-959b-3ef2faf7f803 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:54.105538 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-f8575f3b-2287-43ba-959b-3ef2faf7f803 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] [instance: 82e432fe-fd3a-4e41-b80b-2ba456296e22] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:54.115764 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f8575f3b-2287-43ba-959b-3ef2faf7f803 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:54.119040 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f8575f3b-2287-43ba-959b-3ef2faf7f803 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:54.119780 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f8575f3b-2287-43ba-959b-3ef2faf7f803 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:54.121344 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f8575f3b-2287-43ba-959b-3ef2faf7f803 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:54.122957 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f8575f3b-2287-43ba-959b-3ef2faf7f803 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:54.123744 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f8575f3b-2287-43ba-959b-3ef2faf7f803 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:54.300179 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-f8575f3b-2287-43ba-959b-3ef2faf7f803 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b0732607644878ac97193850006d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112c1533b3ec486199f4e8e52304d19b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:54.311279 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-f8575f3b-2287-43ba-959b-3ef2faf7f803 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] 10.222.0.62 "GET /compute/v2.1/servers/82e432fe-fd3a-4e41-b80b-2ba456296e22" status: 200 len: 1314 microversion: 2.1 time: 0.212630 Aug 10 11:35:54.313834 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 191/379] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:54 2022] GET /compute/v2.1/servers/82e432fe-fd3a-4e41-b80b-2ba456296e22 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:54.327747 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-c028676f-ffb1-48c1-9a08-96086865872d req-fc157172-544d-4fa8-a7fb-1d5cfb33cff6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e6ed242-956f-4b14-8520-18920447bf05", "name": "network-vif-plugged", "status": "completed", "tag": "f3f3926f-a2b3-40b5-a25f-a37b15cc0401"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:35:54.338259 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-c028676f-ffb1-48c1-9a08-96086865872d req-fc157172-544d-4fa8-a7fb-1d5cfb33cff6 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:54.338746 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-c028676f-ffb1-48c1-9a08-96086865872d req-fc157172-544d-4fa8-a7fb-1d5cfb33cff6 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:54.339187 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-c028676f-ffb1-48c1-9a08-96086865872d req-fc157172-544d-4fa8-a7fb-1d5cfb33cff6 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:54.350735 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-c028676f-ffb1-48c1-9a08-96086865872d req-fc157172-544d-4fa8-a7fb-1d5cfb33cff6 service nova] Creating event network-vif-plugged:f3f3926f-a2b3-40b5-a25f-a37b15cc0401 for instance 9e6ed242-956f-4b14-8520-18920447bf05 on hv-cinder-85272 Aug 10 11:35:54.356282 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-c028676f-ffb1-48c1-9a08-96086865872d req-fc157172-544d-4fa8-a7fb-1d5cfb33cff6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032014 Aug 10 11:35:54.357451 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 189/380] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:35:54.370172 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-4c0cc80b-5b92-4ba9-aefc-dc8fc4d3c87b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:54.372048 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-4c0cc80b-5b92-4ba9-aefc-dc8fc4d3c87b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:54.386839 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4c0cc80b-5b92-4ba9-aefc-dc8fc4d3c87b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:54.387480 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4c0cc80b-5b92-4ba9-aefc-dc8fc4d3c87b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:54.399668 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4c0cc80b-5b92-4ba9-aefc-dc8fc4d3c87b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:54.399668 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4c0cc80b-5b92-4ba9-aefc-dc8fc4d3c87b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:54.399668 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4c0cc80b-5b92-4ba9-aefc-dc8fc4d3c87b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:54.399668 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4c0cc80b-5b92-4ba9-aefc-dc8fc4d3c87b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:54.474064 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=4 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:35:54.602114 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-4c0cc80b-5b92-4ba9-aefc-dc8fc4d3c87b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:54.612279 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-4c0cc80b-5b92-4ba9-aefc-dc8fc4d3c87b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:54.614800 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-4c0cc80b-5b92-4ba9-aefc-dc8fc4d3c87b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:54.616276 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-4c0cc80b-5b92-4ba9-aefc-dc8fc4d3c87b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1808 microversion: 2.20 time: 0.249984 Aug 10 11:35:54.617308 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 192/381] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:35:54 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1808 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:35:55.336110 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-c9a54fd7-6d14-4e16-9f99-72da5d3bf570 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:55.336814 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-c9a54fd7-6d14-4e16-9f99-72da5d3bf570 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] [instance: 82e432fe-fd3a-4e41-b80b-2ba456296e22] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:55.343636 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c9a54fd7-6d14-4e16-9f99-72da5d3bf570 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:55.344172 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c9a54fd7-6d14-4e16-9f99-72da5d3bf570 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:55.344614 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c9a54fd7-6d14-4e16-9f99-72da5d3bf570 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:55.345324 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c9a54fd7-6d14-4e16-9f99-72da5d3bf570 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:55.345779 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c9a54fd7-6d14-4e16-9f99-72da5d3bf570 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:55.346284 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c9a54fd7-6d14-4e16-9f99-72da5d3bf570 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:55.463685 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-a2575fc0-007b-4650-b676-4dd100fdbccf tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Action: 'create', calling method: .version_select at 0x7fb7cdeaa5e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1346196899", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSUxdR7q0/du8BLSH3YLzi8ZtuMrzQzalAn7O64naghktB4YbGipxxXfPJ63OY22yqRONZ8J3IduvN/0zNPLua/IL1pXuI4vljGjAEIFChhE+XbgngWkMUF6X6w0w/+6Q=="}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:35:55.480649 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-a2575fc0-007b-4650-b676-4dd100fdbccf tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Getting quotas for project 1c9f7b60a16e438a89c4f7248707ae2d. Resources: {'key_pairs'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:35:55.485181 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-a2575fc0-007b-4650-b676-4dd100fdbccf tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Getting quotas for user 83d48f0f35644f23a0fc2216e5ec5a2c and project 1c9f7b60a16e438a89c4f7248707ae2d. Resources: {'key_pairs'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:35:55.522356 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c9a54fd7-6d14-4e16-9f99-72da5d3bf570 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b0732607644878ac97193850006d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112c1533b3ec486199f4e8e52304d19b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:55.530377 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-c9a54fd7-6d14-4e16-9f99-72da5d3bf570 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] 10.222.0.62 "GET /compute/v2.1/servers/82e432fe-fd3a-4e41-b80b-2ba456296e22" status: 200 len: 1314 microversion: 2.1 time: 0.198777 Aug 10 11:35:55.530960 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 193/382] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:55 2022] GET /compute/v2.1/servers/82e432fe-fd3a-4e41-b80b-2ba456296e22 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:35:55.581738 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-a2575fc0-007b-4650-b676-4dd100fdbccf tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.329474 Aug 10 11:35:55.582458 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 190/383] 10.222.0.62 () {60 vars in 1159 bytes} [Wed Aug 10 11:35:55 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:35:55.646475 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-de305f98-3a31-4eb0-8ad7-0ee175260c7d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:55.647191 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-de305f98-3a31-4eb0-8ad7-0ee175260c7d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:55.653447 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-de305f98-3a31-4eb0-8ad7-0ee175260c7d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:55.653928 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-de305f98-3a31-4eb0-8ad7-0ee175260c7d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:55.654435 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-de305f98-3a31-4eb0-8ad7-0ee175260c7d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:55.655133 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-de305f98-3a31-4eb0-8ad7-0ee175260c7d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:55.655584 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-de305f98-3a31-4eb0-8ad7-0ee175260c7d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:55.656104 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-de305f98-3a31-4eb0-8ad7-0ee175260c7d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:55.826827 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-de305f98-3a31-4eb0-8ad7-0ee175260c7d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:55.835296 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-de305f98-3a31-4eb0-8ad7-0ee175260c7d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:55.836973 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-de305f98-3a31-4eb0-8ad7-0ee175260c7d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:55.838082 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-de305f98-3a31-4eb0-8ad7-0ee175260c7d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1808 microversion: 2.20 time: 0.195809 Aug 10 11:35:55.838663 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 194/384] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:35:55 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1808 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:35:56.379299 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-186fd761-f7e7-467a-bbb5-da7bf1ea3150 req-b32aa257-e01a-46c1-9c3e-bd79fb35d849 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82e432fe-fd3a-4e41-b80b-2ba456296e22", "name": "network-vif-plugged", "status": "completed", "tag": "861ae073-f7b0-484f-8a9a-031e0b047b69"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:35:56.389741 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-186fd761-f7e7-467a-bbb5-da7bf1ea3150 req-b32aa257-e01a-46c1-9c3e-bd79fb35d849 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:56.390304 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-186fd761-f7e7-467a-bbb5-da7bf1ea3150 req-b32aa257-e01a-46c1-9c3e-bd79fb35d849 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:56.391072 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-186fd761-f7e7-467a-bbb5-da7bf1ea3150 req-b32aa257-e01a-46c1-9c3e-bd79fb35d849 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:56.403206 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-186fd761-f7e7-467a-bbb5-da7bf1ea3150 req-b32aa257-e01a-46c1-9c3e-bd79fb35d849 service nova] Creating event network-vif-plugged:861ae073-f7b0-484f-8a9a-031e0b047b69 for instance 82e432fe-fd3a-4e41-b80b-2ba456296e22 on hv-cinder-85272 Aug 10 11:35:56.408117 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-186fd761-f7e7-467a-bbb5-da7bf1ea3150 req-b32aa257-e01a-46c1-9c3e-bd79fb35d849 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034514 Aug 10 11:35:56.408922 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 191/385] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:35:56.551258 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-2df001b1-a10e-4a69-b807-961aa1990661 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:56.551871 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-2df001b1-a10e-4a69-b807-961aa1990661 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] [instance: 82e432fe-fd3a-4e41-b80b-2ba456296e22] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:56.558227 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2df001b1-a10e-4a69-b807-961aa1990661 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:56.558707 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2df001b1-a10e-4a69-b807-961aa1990661 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:56.559163 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2df001b1-a10e-4a69-b807-961aa1990661 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:56.559839 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2df001b1-a10e-4a69-b807-961aa1990661 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:56.560318 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2df001b1-a10e-4a69-b807-961aa1990661 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:56.564766 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2df001b1-a10e-4a69-b807-961aa1990661 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:56.715595 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-2df001b1-a10e-4a69-b807-961aa1990661 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b0732607644878ac97193850006d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112c1533b3ec486199f4e8e52304d19b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:56.723813 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-2df001b1-a10e-4a69-b807-961aa1990661 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] 10.222.0.62 "GET /compute/v2.1/servers/82e432fe-fd3a-4e41-b80b-2ba456296e22" status: 200 len: 1314 microversion: 2.1 time: 0.176976 Aug 10 11:35:56.724428 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 195/386] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:56 2022] GET /compute/v2.1/servers/82e432fe-fd3a-4e41-b80b-2ba456296e22 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:56.861251 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-4dc28773-a15a-4e37-b601-7411d22eb825 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:56.861969 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-4dc28773-a15a-4e37-b601-7411d22eb825 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:56.868536 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4dc28773-a15a-4e37-b601-7411d22eb825 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:56.869028 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4dc28773-a15a-4e37-b601-7411d22eb825 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:56.869474 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4dc28773-a15a-4e37-b601-7411d22eb825 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:56.870220 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4dc28773-a15a-4e37-b601-7411d22eb825 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:56.870723 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4dc28773-a15a-4e37-b601-7411d22eb825 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:56.871162 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4dc28773-a15a-4e37-b601-7411d22eb825 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:57.015676 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-4dc28773-a15a-4e37-b601-7411d22eb825 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:57.026036 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-4dc28773-a15a-4e37-b601-7411d22eb825 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:57.031999 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-4dc28773-a15a-4e37-b601-7411d22eb825 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:57.031999 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-4dc28773-a15a-4e37-b601-7411d22eb825 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1808 microversion: 2.20 time: 0.172214 Aug 10 11:35:57.031999 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 192/387] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:35:56 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:35:57.745338 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-5741ac42-dad1-4142-ae2f-79a926fdac7e tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:57.745947 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-5741ac42-dad1-4142-ae2f-79a926fdac7e tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] [instance: 82e432fe-fd3a-4e41-b80b-2ba456296e22] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:57.752503 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5741ac42-dad1-4142-ae2f-79a926fdac7e tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:57.753004 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5741ac42-dad1-4142-ae2f-79a926fdac7e tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:57.753568 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5741ac42-dad1-4142-ae2f-79a926fdac7e tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:57.754790 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5741ac42-dad1-4142-ae2f-79a926fdac7e tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:57.754790 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5741ac42-dad1-4142-ae2f-79a926fdac7e tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:57.755144 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5741ac42-dad1-4142-ae2f-79a926fdac7e tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:57.920648 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-5741ac42-dad1-4142-ae2f-79a926fdac7e tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b0732607644878ac97193850006d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112c1533b3ec486199f4e8e52304d19b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:57.928310 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-5741ac42-dad1-4142-ae2f-79a926fdac7e tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] 10.222.0.62 "GET /compute/v2.1/servers/82e432fe-fd3a-4e41-b80b-2ba456296e22" status: 200 len: 1314 microversion: 2.1 time: 0.186799 Aug 10 11:35:57.929050 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 196/388] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:57 2022] GET /compute/v2.1/servers/82e432fe-fd3a-4e41-b80b-2ba456296e22 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:58.054586 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-56d328eb-f737-45fa-807a-0964e6bee88c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:58.055343 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-56d328eb-f737-45fa-807a-0964e6bee88c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:58.061860 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-56d328eb-f737-45fa-807a-0964e6bee88c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:58.062350 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-56d328eb-f737-45fa-807a-0964e6bee88c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:58.063039 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-56d328eb-f737-45fa-807a-0964e6bee88c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:58.064009 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-56d328eb-f737-45fa-807a-0964e6bee88c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:58.064461 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-56d328eb-f737-45fa-807a-0964e6bee88c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:58.065060 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-56d328eb-f737-45fa-807a-0964e6bee88c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:58.290192 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-56d328eb-f737-45fa-807a-0964e6bee88c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:58.304455 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-56d328eb-f737-45fa-807a-0964e6bee88c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:58.305698 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-56d328eb-f737-45fa-807a-0964e6bee88c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:58.313733 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-56d328eb-f737-45fa-807a-0964e6bee88c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1808 microversion: 2.20 time: 0.256102 Aug 10 11:35:58.328285 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 193/389] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:35:58 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1808 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:35:58.950907 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-591c9469-a0f0-4d12-b9eb-8148f3be3855 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:58.951690 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-591c9469-a0f0-4d12-b9eb-8148f3be3855 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] [instance: 82e432fe-fd3a-4e41-b80b-2ba456296e22] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:58.964115 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-591c9469-a0f0-4d12-b9eb-8148f3be3855 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:58.966717 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-591c9469-a0f0-4d12-b9eb-8148f3be3855 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:58.968697 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-591c9469-a0f0-4d12-b9eb-8148f3be3855 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:58.969530 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-591c9469-a0f0-4d12-b9eb-8148f3be3855 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:58.970029 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-591c9469-a0f0-4d12-b9eb-8148f3be3855 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:58.970619 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-591c9469-a0f0-4d12-b9eb-8148f3be3855 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:59.151367 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-591c9469-a0f0-4d12-b9eb-8148f3be3855 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b0732607644878ac97193850006d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112c1533b3ec486199f4e8e52304d19b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:59.161452 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-591c9469-a0f0-4d12-b9eb-8148f3be3855 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] 10.222.0.62 "GET /compute/v2.1/servers/82e432fe-fd3a-4e41-b80b-2ba456296e22" status: 200 len: 1314 microversion: 2.1 time: 0.216120 Aug 10 11:35:59.162040 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 197/390] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:58 2022] GET /compute/v2.1/servers/82e432fe-fd3a-4e41-b80b-2ba456296e22 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:59.339924 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-9924ed9b-7e02-4e4d-bdee-e997dbe6af21 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:59.340948 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-9924ed9b-7e02-4e4d-bdee-e997dbe6af21 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:59.348558 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9924ed9b-7e02-4e4d-bdee-e997dbe6af21 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:59.349036 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9924ed9b-7e02-4e4d-bdee-e997dbe6af21 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:59.349465 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9924ed9b-7e02-4e4d-bdee-e997dbe6af21 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:59.350158 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9924ed9b-7e02-4e4d-bdee-e997dbe6af21 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:59.350606 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9924ed9b-7e02-4e4d-bdee-e997dbe6af21 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:59.351028 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9924ed9b-7e02-4e4d-bdee-e997dbe6af21 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:59.491121 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-9924ed9b-7e02-4e4d-bdee-e997dbe6af21 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:59.503277 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-9924ed9b-7e02-4e4d-bdee-e997dbe6af21 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:59.506780 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-9924ed9b-7e02-4e4d-bdee-e997dbe6af21 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:59.508819 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-9924ed9b-7e02-4e4d-bdee-e997dbe6af21 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1795 microversion: 2.20 time: 0.172668 Aug 10 11:35:59.510483 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 194/391] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:35:59 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1795 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:36:00.183399 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-54fdf68e-3040-46e4-87d7-be06e4fd6cd4 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:00.184053 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-54fdf68e-3040-46e4-87d7-be06e4fd6cd4 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] [instance: 82e432fe-fd3a-4e41-b80b-2ba456296e22] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:00.191029 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-54fdf68e-3040-46e4-87d7-be06e4fd6cd4 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:00.191603 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-54fdf68e-3040-46e4-87d7-be06e4fd6cd4 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:00.192252 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-54fdf68e-3040-46e4-87d7-be06e4fd6cd4 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:00.193044 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-54fdf68e-3040-46e4-87d7-be06e4fd6cd4 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:00.193569 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-54fdf68e-3040-46e4-87d7-be06e4fd6cd4 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:00.194146 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-54fdf68e-3040-46e4-87d7-be06e4fd6cd4 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:00.344445 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-54fdf68e-3040-46e4-87d7-be06e4fd6cd4 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b0732607644878ac97193850006d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112c1533b3ec486199f4e8e52304d19b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:00.354770 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-54fdf68e-3040-46e4-87d7-be06e4fd6cd4 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] 10.222.0.62 "GET /compute/v2.1/servers/82e432fe-fd3a-4e41-b80b-2ba456296e22" status: 200 len: 1464 microversion: 2.1 time: 0.175645 Aug 10 11:36:00.355944 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 198/392] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:00 2022] GET /compute/v2.1/servers/82e432fe-fd3a-4e41-b80b-2ba456296e22 => generated 1464 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:00.404824 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-d11ca34a-399a-41bd-be0d-3d31b7e97fd0 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:00.405354 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-d11ca34a-399a-41bd-be0d-3d31b7e97fd0 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] [instance: 82e432fe-fd3a-4e41-b80b-2ba456296e22] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:00.412502 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d11ca34a-399a-41bd-be0d-3d31b7e97fd0 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:00.412992 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d11ca34a-399a-41bd-be0d-3d31b7e97fd0 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:00.413534 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d11ca34a-399a-41bd-be0d-3d31b7e97fd0 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:00.414141 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d11ca34a-399a-41bd-be0d-3d31b7e97fd0 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:00.414599 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d11ca34a-399a-41bd-be0d-3d31b7e97fd0 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:00.415031 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d11ca34a-399a-41bd-be0d-3d31b7e97fd0 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:00.443848 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-d11ca34a-399a-41bd-be0d-3d31b7e97fd0 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] [instance: 82e432fe-fd3a-4e41-b80b-2ba456296e22] Going to try to terminate instance {{(pid=124683) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:36:00.733638 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-d11ca34a-399a-41bd-be0d-3d31b7e97fd0 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] 10.222.0.62 "DELETE /compute/v2.1/servers/82e432fe-fd3a-4e41-b80b-2ba456296e22" status: 204 len: 0 microversion: 2.1 time: 0.332494 Aug 10 11:36:00.734220 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 195/393] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 10 11:36:00 2022] DELETE /compute/v2.1/servers/82e432fe-fd3a-4e41-b80b-2ba456296e22 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:36:00.742821 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-ae6d6cf0-ccf1-484b-b707-75b9ea575dfb tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:00.743633 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-ae6d6cf0-ccf1-484b-b707-75b9ea575dfb tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] [instance: 82e432fe-fd3a-4e41-b80b-2ba456296e22] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:00.750193 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ae6d6cf0-ccf1-484b-b707-75b9ea575dfb tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:00.750781 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ae6d6cf0-ccf1-484b-b707-75b9ea575dfb tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:00.751510 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ae6d6cf0-ccf1-484b-b707-75b9ea575dfb tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:00.752821 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ae6d6cf0-ccf1-484b-b707-75b9ea575dfb tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:00.753348 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ae6d6cf0-ccf1-484b-b707-75b9ea575dfb tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:00.753844 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ae6d6cf0-ccf1-484b-b707-75b9ea575dfb tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:00.891764 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-ae6d6cf0-ccf1-484b-b707-75b9ea575dfb tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b0732607644878ac97193850006d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112c1533b3ec486199f4e8e52304d19b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:00.900166 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-ae6d6cf0-ccf1-484b-b707-75b9ea575dfb tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] 10.222.0.62 "GET /compute/v2.1/servers/82e432fe-fd3a-4e41-b80b-2ba456296e22" status: 200 len: 1470 microversion: 2.1 time: 0.161210 Aug 10 11:36:00.900744 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 199/394] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:00 2022] GET /compute/v2.1/servers/82e432fe-fd3a-4e41-b80b-2ba456296e22 => generated 1470 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:01.922090 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-297098f8-76c6-46e4-a4a0-7d64aac7d0f0 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:01.922812 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-297098f8-76c6-46e4-a4a0-7d64aac7d0f0 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] [instance: 82e432fe-fd3a-4e41-b80b-2ba456296e22] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:01.929911 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-297098f8-76c6-46e4-a4a0-7d64aac7d0f0 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:01.930391 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-297098f8-76c6-46e4-a4a0-7d64aac7d0f0 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:01.930825 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-297098f8-76c6-46e4-a4a0-7d64aac7d0f0 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:01.931520 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-297098f8-76c6-46e4-a4a0-7d64aac7d0f0 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:01.931990 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-297098f8-76c6-46e4-a4a0-7d64aac7d0f0 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:01.932409 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-297098f8-76c6-46e4-a4a0-7d64aac7d0f0 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:02.069523 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-297098f8-76c6-46e4-a4a0-7d64aac7d0f0 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b0732607644878ac97193850006d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112c1533b3ec486199f4e8e52304d19b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:02.077042 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-297098f8-76c6-46e4-a4a0-7d64aac7d0f0 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] 10.222.0.62 "GET /compute/v2.1/servers/82e432fe-fd3a-4e41-b80b-2ba456296e22" status: 200 len: 1470 microversion: 2.1 time: 0.159297 Aug 10 11:36:02.077603 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 196/395] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:01 2022] GET /compute/v2.1/servers/82e432fe-fd3a-4e41-b80b-2ba456296e22 => generated 1470 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:36:03.098519 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-7f6df378-32ce-44e7-baff-c0586b3e9ef0 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:03.099206 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-7f6df378-32ce-44e7-baff-c0586b3e9ef0 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] [instance: 82e432fe-fd3a-4e41-b80b-2ba456296e22] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:03.106467 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7f6df378-32ce-44e7-baff-c0586b3e9ef0 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:03.106975 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7f6df378-32ce-44e7-baff-c0586b3e9ef0 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:03.107424 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7f6df378-32ce-44e7-baff-c0586b3e9ef0 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:03.108200 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7f6df378-32ce-44e7-baff-c0586b3e9ef0 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:03.108663 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7f6df378-32ce-44e7-baff-c0586b3e9ef0 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:03.109097 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7f6df378-32ce-44e7-baff-c0586b3e9ef0 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:03.244093 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-7f6df378-32ce-44e7-baff-c0586b3e9ef0 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b0732607644878ac97193850006d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112c1533b3ec486199f4e8e52304d19b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:03.251865 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-7f6df378-32ce-44e7-baff-c0586b3e9ef0 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] 10.222.0.62 "GET /compute/v2.1/servers/82e432fe-fd3a-4e41-b80b-2ba456296e22" status: 200 len: 1470 microversion: 2.1 time: 0.157173 Aug 10 11:36:03.252480 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 200/396] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:03 2022] GET /compute/v2.1/servers/82e432fe-fd3a-4e41-b80b-2ba456296e22 => generated 1470 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:04.274349 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-9dd48a2a-2c7a-41a3-b06a-4166e9c592c2 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:04.274959 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-9dd48a2a-2c7a-41a3-b06a-4166e9c592c2 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] [instance: 82e432fe-fd3a-4e41-b80b-2ba456296e22] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:04.281353 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9dd48a2a-2c7a-41a3-b06a-4166e9c592c2 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:04.281825 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9dd48a2a-2c7a-41a3-b06a-4166e9c592c2 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:04.282255 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9dd48a2a-2c7a-41a3-b06a-4166e9c592c2 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:04.282929 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9dd48a2a-2c7a-41a3-b06a-4166e9c592c2 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:04.283378 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9dd48a2a-2c7a-41a3-b06a-4166e9c592c2 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:04.283796 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9dd48a2a-2c7a-41a3-b06a-4166e9c592c2 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:04.418064 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-9dd48a2a-2c7a-41a3-b06a-4166e9c592c2 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b0732607644878ac97193850006d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112c1533b3ec486199f4e8e52304d19b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:04.425552 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-9dd48a2a-2c7a-41a3-b06a-4166e9c592c2 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] 10.222.0.62 "GET /compute/v2.1/servers/82e432fe-fd3a-4e41-b80b-2ba456296e22" status: 200 len: 1470 microversion: 2.1 time: 0.155005 Aug 10 11:36:04.426120 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 197/397] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:04 2022] GET /compute/v2.1/servers/82e432fe-fd3a-4e41-b80b-2ba456296e22 => generated 1470 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:05.446621 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-21187330-4e8c-4e4c-b611-afedba6871a1 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:05.447314 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-21187330-4e8c-4e4c-b611-afedba6871a1 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] [instance: 82e432fe-fd3a-4e41-b80b-2ba456296e22] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:05.454119 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-21187330-4e8c-4e4c-b611-afedba6871a1 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:05.454608 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-21187330-4e8c-4e4c-b611-afedba6871a1 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:05.455043 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-21187330-4e8c-4e4c-b611-afedba6871a1 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:05.455756 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-21187330-4e8c-4e4c-b611-afedba6871a1 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:05.456235 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-21187330-4e8c-4e4c-b611-afedba6871a1 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:05.457519 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-21187330-4e8c-4e4c-b611-afedba6871a1 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:05.621557 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-5017a19b-81b3-451c-952c-f037de266a1f req-6c079de9-3011-4e4a-9b26-4a43c3078ada service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82e432fe-fd3a-4e41-b80b-2ba456296e22", "name": "network-vif-deleted", "tag": "861ae073-f7b0-484f-8a9a-031e0b047b69"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:36:05.633851 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-21187330-4e8c-4e4c-b611-afedba6871a1 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b0732607644878ac97193850006d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112c1533b3ec486199f4e8e52304d19b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:05.637618 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=4 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:36:05.639892 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-5017a19b-81b3-451c-952c-f037de266a1f req-6c079de9-3011-4e4a-9b26-4a43c3078ada service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:05.645911 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-5017a19b-81b3-451c-952c-f037de266a1f req-6c079de9-3011-4e4a-9b26-4a43c3078ada service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:05.645911 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-5017a19b-81b3-451c-952c-f037de266a1f req-6c079de9-3011-4e4a-9b26-4a43c3078ada service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:05.646913 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-21187330-4e8c-4e4c-b611-afedba6871a1 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] 10.222.0.62 "GET /compute/v2.1/servers/82e432fe-fd3a-4e41-b80b-2ba456296e22" status: 200 len: 1470 microversion: 2.1 time: 0.203549 Aug 10 11:36:05.647096 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 201/398] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:05 2022] GET /compute/v2.1/servers/82e432fe-fd3a-4e41-b80b-2ba456296e22 => generated 1470 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:05.659634 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-5017a19b-81b3-451c-952c-f037de266a1f req-6c079de9-3011-4e4a-9b26-4a43c3078ada service nova] Creating event network-vif-deleted:861ae073-f7b0-484f-8a9a-031e0b047b69 for instance 82e432fe-fd3a-4e41-b80b-2ba456296e22 on hv-cinder-85272 Aug 10 11:36:05.665693 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-5017a19b-81b3-451c-952c-f037de266a1f req-6c079de9-3011-4e4a-9b26-4a43c3078ada service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048053 Aug 10 11:36:05.668690 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 198/399] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:36:06.668356 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-7066c894-6255-48c7-9343-cc3ad7291de3 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:06.668973 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-7066c894-6255-48c7-9343-cc3ad7291de3 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] [instance: 82e432fe-fd3a-4e41-b80b-2ba456296e22] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:06.676098 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7066c894-6255-48c7-9343-cc3ad7291de3 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:06.676521 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7066c894-6255-48c7-9343-cc3ad7291de3 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:06.677397 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7066c894-6255-48c7-9343-cc3ad7291de3 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:06.677752 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7066c894-6255-48c7-9343-cc3ad7291de3 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:06.678211 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7066c894-6255-48c7-9343-cc3ad7291de3 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:06.678643 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7066c894-6255-48c7-9343-cc3ad7291de3 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:06.710640 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7066c894-6255-48c7-9343-cc3ad7291de3 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:06.711121 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7066c894-6255-48c7-9343-cc3ad7291de3 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:06.711558 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7066c894-6255-48c7-9343-cc3ad7291de3 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:06.712024 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.objects.instance [None req-7066c894-6255-48c7-9343-cc3ad7291de3 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lazy-loading 'fault' on Instance uuid 82e432fe-fd3a-4e41-b80b-2ba456296e22 {{(pid=124682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:36:06.753339 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-7066c894-6255-48c7-9343-cc3ad7291de3 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b0732607644878ac97193850006d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112c1533b3ec486199f4e8e52304d19b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:06.760768 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-7066c894-6255-48c7-9343-cc3ad7291de3 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] 10.222.0.62 "GET /compute/v2.1/servers/82e432fe-fd3a-4e41-b80b-2ba456296e22" status: 200 len: 1304 microversion: 2.1 time: 0.096243 Aug 10 11:36:06.761327 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 202/400] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:06 2022] GET /compute/v2.1/servers/82e432fe-fd3a-4e41-b80b-2ba456296e22 => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:07.784100 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-4985525b-9bbb-48e0-959b-a6ad97d1b00b tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:07.785517 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-4985525b-9bbb-48e0-959b-a6ad97d1b00b tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] [instance: 82e432fe-fd3a-4e41-b80b-2ba456296e22] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:07.792836 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4985525b-9bbb-48e0-959b-a6ad97d1b00b tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:07.793400 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4985525b-9bbb-48e0-959b-a6ad97d1b00b tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:07.794015 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4985525b-9bbb-48e0-959b-a6ad97d1b00b tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:07.794851 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4985525b-9bbb-48e0-959b-a6ad97d1b00b tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:07.795315 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4985525b-9bbb-48e0-959b-a6ad97d1b00b tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:07.795742 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4985525b-9bbb-48e0-959b-a6ad97d1b00b tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:07.829602 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4985525b-9bbb-48e0-959b-a6ad97d1b00b tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:07.830077 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4985525b-9bbb-48e0-959b-a6ad97d1b00b tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:07.830511 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4985525b-9bbb-48e0-959b-a6ad97d1b00b tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:07.830947 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.objects.instance [None req-4985525b-9bbb-48e0-959b-a6ad97d1b00b tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lazy-loading 'fault' on Instance uuid 82e432fe-fd3a-4e41-b80b-2ba456296e22 {{(pid=124683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:36:07.875587 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-4985525b-9bbb-48e0-959b-a6ad97d1b00b tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b0732607644878ac97193850006d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112c1533b3ec486199f4e8e52304d19b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:07.883795 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-4985525b-9bbb-48e0-959b-a6ad97d1b00b tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] 10.222.0.62 "GET /compute/v2.1/servers/82e432fe-fd3a-4e41-b80b-2ba456296e22" status: 200 len: 1304 microversion: 2.1 time: 0.104752 Aug 10 11:36:07.884385 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 199/401] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:07 2022] GET /compute/v2.1/servers/82e432fe-fd3a-4e41-b80b-2ba456296e22 => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:08.904400 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-82c04541-88bc-49a1-8b16-6799d9ca2921 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:08.905000 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-82c04541-88bc-49a1-8b16-6799d9ca2921 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] [instance: 82e432fe-fd3a-4e41-b80b-2ba456296e22] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:08.911623 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-82c04541-88bc-49a1-8b16-6799d9ca2921 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:08.912140 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-82c04541-88bc-49a1-8b16-6799d9ca2921 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:08.912576 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-82c04541-88bc-49a1-8b16-6799d9ca2921 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:08.913270 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-82c04541-88bc-49a1-8b16-6799d9ca2921 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:08.913720 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-82c04541-88bc-49a1-8b16-6799d9ca2921 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:08.914140 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-82c04541-88bc-49a1-8b16-6799d9ca2921 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:08.947915 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-82c04541-88bc-49a1-8b16-6799d9ca2921 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:08.948427 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-82c04541-88bc-49a1-8b16-6799d9ca2921 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:08.948860 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-82c04541-88bc-49a1-8b16-6799d9ca2921 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:08.949308 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.objects.instance [None req-82c04541-88bc-49a1-8b16-6799d9ca2921 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lazy-loading 'fault' on Instance uuid 82e432fe-fd3a-4e41-b80b-2ba456296e22 {{(pid=124682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:36:08.991632 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-82c04541-88bc-49a1-8b16-6799d9ca2921 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b0732607644878ac97193850006d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112c1533b3ec486199f4e8e52304d19b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:08.999150 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-82c04541-88bc-49a1-8b16-6799d9ca2921 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] 10.222.0.62 "GET /compute/v2.1/servers/82e432fe-fd3a-4e41-b80b-2ba456296e22" status: 200 len: 1304 microversion: 2.1 time: 0.098609 Aug 10 11:36:09.005421 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 203/402] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:08 2022] GET /compute/v2.1/servers/82e432fe-fd3a-4e41-b80b-2ba456296e22 => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:10.020977 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-96df5e2b-1d91-4c4c-94c7-d355429fa863 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:10.021608 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-96df5e2b-1d91-4c4c-94c7-d355429fa863 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] [instance: 82e432fe-fd3a-4e41-b80b-2ba456296e22] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:10.028644 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-96df5e2b-1d91-4c4c-94c7-d355429fa863 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:10.029132 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-96df5e2b-1d91-4c4c-94c7-d355429fa863 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:10.029603 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-96df5e2b-1d91-4c4c-94c7-d355429fa863 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:10.030297 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-96df5e2b-1d91-4c4c-94c7-d355429fa863 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:10.030787 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-96df5e2b-1d91-4c4c-94c7-d355429fa863 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:10.031215 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-96df5e2b-1d91-4c4c-94c7-d355429fa863 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:10.044934 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-96df5e2b-1d91-4c4c-94c7-d355429fa863 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] HTTP exception thrown: Instance 82e432fe-fd3a-4e41-b80b-2ba456296e22 could not be found. Aug 10 11:36:10.053977 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-96df5e2b-1d91-4c4c-94c7-d355429fa863 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Request method failure captured: Aug 10 11:36:10.053977 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: request: GET /compute/v2.1/servers/82e432fe-fd3a-4e41-b80b-2ba456296e22 HTTP/1.1 Aug 10 11:36:10.053977 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept: application/json Aug 10 11:36:10.053977 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Aug 10 11:36:10.053977 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Connection: close Aug 10 11:36:10.053977 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Length: 0 Aug 10 11:36:10.053977 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Type: application/json Aug 10 11:36:10.053977 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Host: 10.222.0.62 Aug 10 11:36:10.053977 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Aug 10 11:36:10.053977 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.11 Aug 10 11:36:10.053977 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABi85gGr1IrAm0JRIBThMHrjmJ9AxKo6xKYXUoeD9W-3sm0axZVOOyCV-kzTyho1LAyBXVTQVhnOhsY3E-rHuNfjpYwP2PHudYJYuu_nFgF-RxoHYWSGnQQIIpBVIhe1EKPxwoPa5bLhmQYDKF7LG2PhOkhCk99z2zFSGJyPnamIibiS0Y Aug 10 11:36:10.053977 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Aug 10 11:36:10.053977 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Aug 10 11:36:10.053977 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Aug 10 11:36:10.053977 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Aug 10 11:36:10.053977 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Aug 10 11:36:10.053977 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Aug 10 11:36:10.053977 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Id: 112c1533b3ec486199f4e8e52304d19b Aug 10 11:36:10.053977 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-VolumesNegativeTest-2001620950 Aug 10 11:36:10.053977 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Role: member,reader Aug 10 11:36:10.053977 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Aug 10 11:36:10.055576 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/112c1533b3ec486199f4e8e52304d19b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_112c1533b3ec486199f4e8e52304d19b", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/112c1533b3ec486199f4e8e52304d19b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/112c1533b3ec486199f4e8e52304d19b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:36:10.055576 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-VolumesNegativeTest-2001620950 Aug 10 11:36:10.055576 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Id: 112c1533b3ec486199f4e8e52304d19b Aug 10 11:36:10.055576 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-VolumesNegativeTest-2001620950 Aug 10 11:36:10.055576 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User: tempest-VolumesNegativeTest-2001620950-project Aug 10 11:36:10.055576 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Aug 10 11:36:10.055576 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Aug 10 11:36:10.055576 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Id: 95b0732607644878ac97193850006d07 Aug 10 11:36:10.055576 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-VolumesNegativeTest-2001620950-project Aug 10 11:36:10.055576 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: method: > Aug 10 11:36:10.055576 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: exception: Instance 82e432fe-fd3a-4e41-b80b-2ba456296e22 could not be found. Aug 10 11:36:10.055576 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: action_args: {'id': '82e432fe-fd3a-4e41-b80b-2ba456296e22'} Aug 10 11:36:10.056407 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:36:10.056407 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:36:10.056407 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:36:10.056407 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:36:10.056407 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:36:10.056407 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:36:10.056407 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:36:10.056407 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:36:10.056407 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:36:10.056407 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:36:10.056407 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82e432fe-fd3a-4e41-b80b-2ba456296e22 could not be found. Aug 10 11:36:10.056407 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:36:10.056407 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:36:10.056407 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:36:10.056407 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:36:10.056407 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:36:10.056407 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:36:10.056407 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:36:10.056407 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:36:10.056407 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:36:10.057667 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:36:10.057667 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:36:10.057667 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:36:10.057667 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:36:10.057667 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:36:10.057667 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:36:10.057667 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:36:10.057667 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82e432fe-fd3a-4e41-b80b-2ba456296e22 could not be found. Aug 10 11:36:10.057667 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:36:10.057667 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:36:10.057667 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:36:10.057667 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:36:10.057667 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:36:10.057667 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:36:10.057667 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:36:10.057667 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:36:10.057667 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82e432fe-fd3a-4e41-b80b-2ba456296e22 could not be found. Aug 10 11:36:10.057667 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:36:10.058775 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-96df5e2b-1d91-4c4c-94c7-d355429fa863 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] Returning 404 to user: Instance 82e432fe-fd3a-4e41-b80b-2ba456296e22 could not be found. {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:36:10.058775 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-96df5e2b-1d91-4c4c-94c7-d355429fa863 tempest-VolumesNegativeTest-2001620950 tempest-VolumesNegativeTest-2001620950-project] 10.222.0.62 "GET /compute/v2.1/servers/82e432fe-fd3a-4e41-b80b-2ba456296e22" status: 404 len: 111 microversion: 2.1 time: 0.031092 Aug 10 11:36:10.058775 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 200/403] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:10 2022] GET /compute/v2.1/servers/82e432fe-fd3a-4e41-b80b-2ba456296e22 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:36:13.405493 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-943b5107-6f21-466a-9d05-26a831cb3949 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b892eb7-3331-4840-a16d-f1f7d17913eb"}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:36:13.409692 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-943b5107-6f21-466a-9d05-26a831cb3949 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:13.417694 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-943b5107-6f21-466a-9d05-26a831cb3949 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:13.418218 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-943b5107-6f21-466a-9d05-26a831cb3949 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:13.418660 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-943b5107-6f21-466a-9d05-26a831cb3949 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:13.419487 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-943b5107-6f21-466a-9d05-26a831cb3949 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:13.419949 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-943b5107-6f21-466a-9d05-26a831cb3949 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:13.420718 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-943b5107-6f21-466a-9d05-26a831cb3949 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:14.643976 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f3dfbb71-e745-435a-828c-b20f86e410d7 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:14.644530 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-f3dfbb71-e745-435a-828c-b20f86e410d7 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:14.651505 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f3dfbb71-e745-435a-828c-b20f86e410d7 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:14.652018 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f3dfbb71-e745-435a-828c-b20f86e410d7 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:14.652461 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f3dfbb71-e745-435a-828c-b20f86e410d7 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:14.653157 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f3dfbb71-e745-435a-828c-b20f86e410d7 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:14.653612 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f3dfbb71-e745-435a-828c-b20f86e410d7 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:14.654037 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f3dfbb71-e745-435a-828c-b20f86e410d7 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:14.778914 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.objects.instance [None req-f3dfbb71-e745-435a-828c-b20f86e410d7 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lazy-loading 'services' on Instance uuid 61282604-5de4-413b-be4c-80aadca981b3 {{(pid=124683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:36:14.989785 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-943b5107-6f21-466a-9d05-26a831cb3949 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "POST /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.588664 Aug 10 11:36:14.994239 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-f3dfbb71-e745-435a-828c-b20f86e410d7 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "DELETE /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3/os-volume_attachments/9fde986d-5a28-4354-95ed-19abf35eab0e" status: 202 len: 0 microversion: 2.1 time: 0.353743 Aug 10 11:36:14.994239 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 201/404] 10.222.0.62 () {58 vars in 1416 bytes} [Wed Aug 10 11:36:14 2022] DELETE /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3/os-volume_attachments/9fde986d-5a28-4354-95ed-19abf35eab0e => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 11:36:14.994483 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 204/405] 10.222.0.62 () {60 vars in 1323 bytes} [Wed Aug 10 11:36:13 2022] POST /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5/os-volume_attachments => generated 194 bytes in 1591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:36:17.172582 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-ab21dddd-6dbf-4f71-bb0c-c9c0f9598629 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:36:17.177310 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:36:17.180938 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ab21dddd-6dbf-4f71-bb0c-c9c0f9598629 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:17.181433 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ab21dddd-6dbf-4f71-bb0c-c9c0f9598629 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:17.181869 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ab21dddd-6dbf-4f71-bb0c-c9c0f9598629 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:17.207394 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-ab21dddd-6dbf-4f71-bb0c-c9c0f9598629 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Going to try to stop instance {{(pid=124683) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 10 11:36:17.376815 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-ab21dddd-6dbf-4f71-bb0c-c9c0f9598629 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "POST /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3/action" status: 202 len: 0 microversion: 2.1 time: 0.208623 Aug 10 11:36:17.377403 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 202/406] 10.222.0.62 () {60 vars in 1278 bytes} [Wed Aug 10 11:36:17 2022] POST /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 11:36:17.387628 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-2631fe17-9a91-40ce-b8f6-22b3f9402167 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:17.388361 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-2631fe17-9a91-40ce-b8f6-22b3f9402167 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:17.391683 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=46 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:36:17.395306 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2631fe17-9a91-40ce-b8f6-22b3f9402167 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:17.395795 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2631fe17-9a91-40ce-b8f6-22b3f9402167 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:17.396271 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2631fe17-9a91-40ce-b8f6-22b3f9402167 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:17.397805 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2631fe17-9a91-40ce-b8f6-22b3f9402167 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:17.398262 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2631fe17-9a91-40ce-b8f6-22b3f9402167 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:17.398696 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2631fe17-9a91-40ce-b8f6-22b3f9402167 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:17.414444 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:36:17.543884 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-2631fe17-9a91-40ce-b8f6-22b3f9402167 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:17.551567 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-2631fe17-9a91-40ce-b8f6-22b3f9402167 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1677 microversion: 2.1 time: 0.168951 Aug 10 11:36:17.552253 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 205/407] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:17 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:18.575234 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-48b56a56-11f9-44f5-8c9e-0366f61e37f8 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:18.575941 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-48b56a56-11f9-44f5-8c9e-0366f61e37f8 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:18.582167 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-48b56a56-11f9-44f5-8c9e-0366f61e37f8 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:18.582656 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-48b56a56-11f9-44f5-8c9e-0366f61e37f8 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:18.584365 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-48b56a56-11f9-44f5-8c9e-0366f61e37f8 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:18.584365 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-48b56a56-11f9-44f5-8c9e-0366f61e37f8 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:18.584365 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-48b56a56-11f9-44f5-8c9e-0366f61e37f8 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:18.585310 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-48b56a56-11f9-44f5-8c9e-0366f61e37f8 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:18.716869 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-48b56a56-11f9-44f5-8c9e-0366f61e37f8 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:18.724661 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-48b56a56-11f9-44f5-8c9e-0366f61e37f8 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1677 microversion: 2.1 time: 0.154555 Aug 10 11:36:18.725732 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 203/408] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:18 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:18.738610 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-e2433488-8d01-4d4c-971a-b000854ef917 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:18.739114 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-e2433488-8d01-4d4c-971a-b000854ef917 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 95b0dee9-162e-4edc-98e5-a6d36ce71ec1] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:18.746844 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e2433488-8d01-4d4c-971a-b000854ef917 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:18.747325 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e2433488-8d01-4d4c-971a-b000854ef917 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:18.747765 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e2433488-8d01-4d4c-971a-b000854ef917 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:18.748479 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e2433488-8d01-4d4c-971a-b000854ef917 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:18.748943 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e2433488-8d01-4d4c-971a-b000854ef917 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:18.749368 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e2433488-8d01-4d4c-971a-b000854ef917 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:18.877833 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.objects.instance [None req-e2433488-8d01-4d4c-971a-b000854ef917 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lazy-loading 'services' on Instance uuid 95b0dee9-162e-4edc-98e5-a6d36ce71ec1 {{(pid=124682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:36:19.178508 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-e2433488-8d01-4d4c-971a-b000854ef917 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] 10.222.0.62 "DELETE /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1/os-volume_attachments/7f6c3510-1905-4c98-9024-b7708066068d" status: 202 len: 0 microversion: 2.1 time: 0.443830 Aug 10 11:36:19.179363 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 206/409] 10.222.0.62 () {58 vars in 1416 bytes} [Wed Aug 10 11:36:18 2022] DELETE /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1/os-volume_attachments/7f6c3510-1905-4c98-9024-b7708066068d => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:36:19.750115 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-28c49189-817a-4438-8e35-ab86ca01e9f0 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:19.750633 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-28c49189-817a-4438-8e35-ab86ca01e9f0 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:19.757893 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-28c49189-817a-4438-8e35-ab86ca01e9f0 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:19.758467 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-28c49189-817a-4438-8e35-ab86ca01e9f0 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:19.758902 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-28c49189-817a-4438-8e35-ab86ca01e9f0 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:19.759582 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-28c49189-817a-4438-8e35-ab86ca01e9f0 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:19.760055 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-28c49189-817a-4438-8e35-ab86ca01e9f0 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:19.760477 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-28c49189-817a-4438-8e35-ab86ca01e9f0 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:19.892776 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-28c49189-817a-4438-8e35-ab86ca01e9f0 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:19.900595 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-28c49189-817a-4438-8e35-ab86ca01e9f0 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1677 microversion: 2.1 time: 0.154428 Aug 10 11:36:19.901153 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 204/410] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:19 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:20.389017 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-0b776d47-c4b1-43cb-89c8-490605941d11 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-899693618", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1346196899", "security_groups": [{"name": "tempest-secgroup-smoke-1297018732"}], "block_device_mapping_v2": [{"uuid": "e6f1e6d3-3448-489e-801c-3f45a1e02a0a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0d452e82-3b0d-4e6a-b6c3-744763a38d5a"}]}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:36:20.536919 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.network.neutron [None req-0b776d47-c4b1-43cb-89c8-490605941d11 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] validate_networks() for [('0d452e82-3b0d-4e6a-b6c3-744763a38d5a', None, None, None, None, None)] {{(pid=124682) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:36:20.905394 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-0b776d47-c4b1-43cb-89c8-490605941d11 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Flavor limits 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:36:20.905820 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-0b776d47-c4b1-43cb-89c8-490605941d11 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Image limits 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:36:20.906290 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-0b776d47-c4b1-43cb-89c8-490605941d11 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Flavor pref 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:36:20.906699 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-0b776d47-c4b1-43cb-89c8-490605941d11 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Image pref 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:36:20.907246 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-0b776d47-c4b1-43cb-89c8-490605941d11 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:36:20.916541 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0b776d47-c4b1-43cb-89c8-490605941d11 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:20.917023 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0b776d47-c4b1-43cb-89c8-490605941d11 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:20.917464 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0b776d47-c4b1-43cb-89c8-490605941d11 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:20.918195 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0b776d47-c4b1-43cb-89c8-490605941d11 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:20.918649 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0b776d47-c4b1-43cb-89c8-490605941d11 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:20.919072 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0b776d47-c4b1-43cb-89c8-490605941d11 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:20.922622 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-026cfce1-951e-4d03-abad-e2806d7e7ec2 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:20.923373 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-026cfce1-951e-4d03-abad-e2806d7e7ec2 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:20.930260 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-026cfce1-951e-4d03-abad-e2806d7e7ec2 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:20.930737 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-026cfce1-951e-4d03-abad-e2806d7e7ec2 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:20.931173 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-026cfce1-951e-4d03-abad-e2806d7e7ec2 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:20.931866 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-026cfce1-951e-4d03-abad-e2806d7e7ec2 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:20.932354 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-026cfce1-951e-4d03-abad-e2806d7e7ec2 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:20.932776 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-026cfce1-951e-4d03-abad-e2806d7e7ec2 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:20.936779 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-0b776d47-c4b1-43cb-89c8-490605941d11 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Getting quotas for project 1c9f7b60a16e438a89c4f7248707ae2d. Resources: {'ram', 'instances', 'cores'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:36:20.936898 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:36:20.940757 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-0b776d47-c4b1-43cb-89c8-490605941d11 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Getting quotas for user 83d48f0f35644f23a0fc2216e5ec5a2c and project 1c9f7b60a16e438a89c4f7248707ae2d. Resources: {'ram', 'instances', 'cores'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:36:21.000062 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-0b776d47-c4b1-43cb-89c8-490605941d11 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Going to run 1 instances... {{(pid=124682) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:36:21.002411 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-0b776d47-c4b1-43cb-89c8-490605941d11 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: ed538b97-8602-402c-8ef9-e25e6d71356a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e6f1e6d3-3448-489e-801c-3f45a1e02a0a',volume_size=None,volume_type=None)] {{(pid=124682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:36:21.066810 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-026cfce1-951e-4d03-abad-e2806d7e7ec2 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:21.074911 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-026cfce1-951e-4d03-abad-e2806d7e7ec2 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1677 microversion: 2.1 time: 0.156103 Aug 10 11:36:21.075477 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 205/411] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:20 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:36:21.335443 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-0b776d47-c4b1-43cb-89c8-490605941d11 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.951385 Aug 10 11:36:21.336289 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 207/412] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Aug 10 11:36:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 953 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 11:36:21.347253 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-dbaed896-2078-4249-862a-7452ab24453d tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:21.348240 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-dbaed896-2078-4249-862a-7452ab24453d tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: ed538b97-8602-402c-8ef9-e25e6d71356a] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:21.407376 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-dbaed896-2078-4249-862a-7452ab24453d tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:21.416414 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-dbaed896-2078-4249-862a-7452ab24453d tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a" status: 200 len: 1094 microversion: 2.1 time: 0.072699 Aug 10 11:36:21.417843 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 206/413] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:21 2022] GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a => generated 1094 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:22.095186 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-81bd3165-36ee-448a-9514-8be1016aadcc tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:22.095799 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-81bd3165-36ee-448a-9514-8be1016aadcc tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:22.102526 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-81bd3165-36ee-448a-9514-8be1016aadcc tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:22.103002 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-81bd3165-36ee-448a-9514-8be1016aadcc tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:22.103462 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-81bd3165-36ee-448a-9514-8be1016aadcc tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:22.104167 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-81bd3165-36ee-448a-9514-8be1016aadcc tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:22.104616 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-81bd3165-36ee-448a-9514-8be1016aadcc tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:22.105038 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-81bd3165-36ee-448a-9514-8be1016aadcc tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:22.244758 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-81bd3165-36ee-448a-9514-8be1016aadcc tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:22.252470 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-81bd3165-36ee-448a-9514-8be1016aadcc tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1677 microversion: 2.1 time: 0.161228 Aug 10 11:36:22.253032 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 208/414] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:22 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:22.443870 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-8ee6b2d4-1c6f-4d19-9e88-db40795586a7 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:22.444519 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-8ee6b2d4-1c6f-4d19-9e88-db40795586a7 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: ed538b97-8602-402c-8ef9-e25e6d71356a] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:22.451672 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8ee6b2d4-1c6f-4d19-9e88-db40795586a7 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:22.452246 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8ee6b2d4-1c6f-4d19-9e88-db40795586a7 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:22.452695 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8ee6b2d4-1c6f-4d19-9e88-db40795586a7 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:22.453392 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8ee6b2d4-1c6f-4d19-9e88-db40795586a7 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:22.453857 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8ee6b2d4-1c6f-4d19-9e88-db40795586a7 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:22.454288 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8ee6b2d4-1c6f-4d19-9e88-db40795586a7 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:22.518556 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-8ee6b2d4-1c6f-4d19-9e88-db40795586a7 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:22.530416 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-8ee6b2d4-1c6f-4d19-9e88-db40795586a7 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a" status: 200 len: 1144 microversion: 2.1 time: 0.090436 Aug 10 11:36:22.530994 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 207/415] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:22 2022] GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a => generated 1144 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:23.274828 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-eb66a0b1-8059-4519-87e3-659fbeef3992 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:23.275533 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-eb66a0b1-8059-4519-87e3-659fbeef3992 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:23.281950 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-eb66a0b1-8059-4519-87e3-659fbeef3992 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:23.282435 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-eb66a0b1-8059-4519-87e3-659fbeef3992 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:23.282872 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-eb66a0b1-8059-4519-87e3-659fbeef3992 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:23.283558 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-eb66a0b1-8059-4519-87e3-659fbeef3992 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:23.284045 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-eb66a0b1-8059-4519-87e3-659fbeef3992 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:23.284477 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-eb66a0b1-8059-4519-87e3-659fbeef3992 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:23.412413 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-eb66a0b1-8059-4519-87e3-659fbeef3992 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:23.419756 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-eb66a0b1-8059-4519-87e3-659fbeef3992 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1677 microversion: 2.1 time: 0.149547 Aug 10 11:36:23.420360 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 209/416] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:23 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:23.555287 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-0aaad614-3f13-40e1-8895-accd72c3dcd9 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:23.556804 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-0aaad614-3f13-40e1-8895-accd72c3dcd9 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: ed538b97-8602-402c-8ef9-e25e6d71356a] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:23.563482 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0aaad614-3f13-40e1-8895-accd72c3dcd9 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:23.585900 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0aaad614-3f13-40e1-8895-accd72c3dcd9 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:23.585900 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0aaad614-3f13-40e1-8895-accd72c3dcd9 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:23.585900 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0aaad614-3f13-40e1-8895-accd72c3dcd9 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:23.585900 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0aaad614-3f13-40e1-8895-accd72c3dcd9 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:23.586546 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0aaad614-3f13-40e1-8895-accd72c3dcd9 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:23.640098 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-0aaad614-3f13-40e1-8895-accd72c3dcd9 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:23.645823 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-0aaad614-3f13-40e1-8895-accd72c3dcd9 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a" status: 200 len: 1136 microversion: 2.1 time: 0.097244 Aug 10 11:36:23.646403 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 208/417] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:23 2022] GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a => generated 1136 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:24.441140 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-c9f4c53d-e0bb-4de2-b988-6e357eba0533 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:24.441675 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-c9f4c53d-e0bb-4de2-b988-6e357eba0533 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:24.448198 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c9f4c53d-e0bb-4de2-b988-6e357eba0533 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:24.448680 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c9f4c53d-e0bb-4de2-b988-6e357eba0533 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:24.449119 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c9f4c53d-e0bb-4de2-b988-6e357eba0533 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:24.449805 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c9f4c53d-e0bb-4de2-b988-6e357eba0533 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:24.450258 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c9f4c53d-e0bb-4de2-b988-6e357eba0533 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:24.450680 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c9f4c53d-e0bb-4de2-b988-6e357eba0533 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:24.580134 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c9f4c53d-e0bb-4de2-b988-6e357eba0533 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:24.588283 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-c9f4c53d-e0bb-4de2-b988-6e357eba0533 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1677 microversion: 2.1 time: 0.151021 Aug 10 11:36:24.588844 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 210/418] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:24 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:24.668062 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-ca528d86-10e0-4d98-aede-6a3c41b1c3ea tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:24.677525 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-ca528d86-10e0-4d98-aede-6a3c41b1c3ea tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: ed538b97-8602-402c-8ef9-e25e6d71356a] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:24.677525 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ca528d86-10e0-4d98-aede-6a3c41b1c3ea tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:24.677525 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ca528d86-10e0-4d98-aede-6a3c41b1c3ea tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:24.677525 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ca528d86-10e0-4d98-aede-6a3c41b1c3ea tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:24.678749 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ca528d86-10e0-4d98-aede-6a3c41b1c3ea tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:24.678749 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ca528d86-10e0-4d98-aede-6a3c41b1c3ea tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:24.678749 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ca528d86-10e0-4d98-aede-6a3c41b1c3ea tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:24.740455 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-ca528d86-10e0-4d98-aede-6a3c41b1c3ea tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:24.747114 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-ca528d86-10e0-4d98-aede-6a3c41b1c3ea tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a" status: 200 len: 1192 microversion: 2.1 time: 0.082922 Aug 10 11:36:24.747668 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 209/419] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:24 2022] GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a => generated 1192 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:36:24.756894 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-d4b9a1b9-4c6e-4135-a4ad-c7858e4033e6 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:36:24.759419 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-d4b9a1b9-4c6e-4135-a4ad-c7858e4033e6 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:24.765967 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d4b9a1b9-4c6e-4135-a4ad-c7858e4033e6 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:24.766454 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d4b9a1b9-4c6e-4135-a4ad-c7858e4033e6 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:24.766890 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d4b9a1b9-4c6e-4135-a4ad-c7858e4033e6 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:24.767579 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d4b9a1b9-4c6e-4135-a4ad-c7858e4033e6 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:24.768067 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d4b9a1b9-4c6e-4135-a4ad-c7858e4033e6 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:24.768529 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d4b9a1b9-4c6e-4135-a4ad-c7858e4033e6 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:24.794656 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.objects.instance [None req-d4b9a1b9-4c6e-4135-a4ad-c7858e4033e6 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lazy-loading 'flavor' on Instance uuid f70dab9f-931f-4e70-bb09-0a053d3220a5 {{(pid=124682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:36:25.108859 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-d4b9a1b9-4c6e-4135-a4ad-c7858e4033e6 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "POST /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5/action" status: 200 len: 32 microversion: 2.1 time: 0.358086 Aug 10 11:36:25.109526 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 211/420] 10.222.0.62 () {60 vars in 1278 bytes} [Wed Aug 10 11:36:24 2022] POST /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5/action => generated 32 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 11:36:25.119717 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-b4d37adc-eb4a-42dc-8d3a-6ee467b8e216 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:25.120385 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-b4d37adc-eb4a-42dc-8d3a-6ee467b8e216 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:25.126432 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b4d37adc-eb4a-42dc-8d3a-6ee467b8e216 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:25.126917 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b4d37adc-eb4a-42dc-8d3a-6ee467b8e216 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:25.127355 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b4d37adc-eb4a-42dc-8d3a-6ee467b8e216 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:25.128078 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b4d37adc-eb4a-42dc-8d3a-6ee467b8e216 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:25.128539 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b4d37adc-eb4a-42dc-8d3a-6ee467b8e216 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:25.129016 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b4d37adc-eb4a-42dc-8d3a-6ee467b8e216 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:25.262482 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-b4d37adc-eb4a-42dc-8d3a-6ee467b8e216 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:25.270650 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-b4d37adc-eb4a-42dc-8d3a-6ee467b8e216 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5" status: 200 len: 1734 microversion: 2.1 time: 0.155452 Aug 10 11:36:25.271212 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 210/421] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:25 2022] GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:25.610857 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-507e716e-48e2-49cf-a6b5-278925b0410a tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:25.611575 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-507e716e-48e2-49cf-a6b5-278925b0410a tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:25.618829 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-507e716e-48e2-49cf-a6b5-278925b0410a tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:25.619304 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-507e716e-48e2-49cf-a6b5-278925b0410a tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:25.619765 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-507e716e-48e2-49cf-a6b5-278925b0410a tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:25.620463 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-507e716e-48e2-49cf-a6b5-278925b0410a tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:25.620914 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-507e716e-48e2-49cf-a6b5-278925b0410a tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:25.621333 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-507e716e-48e2-49cf-a6b5-278925b0410a tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:25.749064 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-507e716e-48e2-49cf-a6b5-278925b0410a tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:25.757111 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-507e716e-48e2-49cf-a6b5-278925b0410a tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1677 microversion: 2.1 time: 0.150374 Aug 10 11:36:25.757685 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 212/422] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:25 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:25.767749 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-43a22362-fd42-4920-908a-19c8528fc629 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:25.768389 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-43a22362-fd42-4920-908a-19c8528fc629 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: ed538b97-8602-402c-8ef9-e25e6d71356a] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:25.775502 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-43a22362-fd42-4920-908a-19c8528fc629 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:25.776005 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-43a22362-fd42-4920-908a-19c8528fc629 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:25.776441 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-43a22362-fd42-4920-908a-19c8528fc629 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:25.777128 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-43a22362-fd42-4920-908a-19c8528fc629 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:25.777589 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-43a22362-fd42-4920-908a-19c8528fc629 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:25.778019 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-43a22362-fd42-4920-908a-19c8528fc629 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:25.837262 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-43a22362-fd42-4920-908a-19c8528fc629 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:25.844453 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-43a22362-fd42-4920-908a-19c8528fc629 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a" status: 200 len: 1192 microversion: 2.1 time: 0.080712 Aug 10 11:36:25.845004 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 211/423] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:25 2022] GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a => generated 1192 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:26.292654 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-6e7a0ef6-1b10-412d-a333-f85b73ab5790 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:26.293258 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-6e7a0ef6-1b10-412d-a333-f85b73ab5790 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:26.299078 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6e7a0ef6-1b10-412d-a333-f85b73ab5790 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:26.299553 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6e7a0ef6-1b10-412d-a333-f85b73ab5790 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:26.300005 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6e7a0ef6-1b10-412d-a333-f85b73ab5790 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:26.300686 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6e7a0ef6-1b10-412d-a333-f85b73ab5790 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:26.301137 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6e7a0ef6-1b10-412d-a333-f85b73ab5790 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:26.301564 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6e7a0ef6-1b10-412d-a333-f85b73ab5790 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:26.429417 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-6e7a0ef6-1b10-412d-a333-f85b73ab5790 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:26.437288 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-6e7a0ef6-1b10-412d-a333-f85b73ab5790 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5" status: 200 len: 1734 microversion: 2.1 time: 0.148461 Aug 10 11:36:26.437853 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 213/424] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:26 2022] GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:26.778580 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-2d081e76-70c9-43b5-a458-e1b2b8cd32eb tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:26.779187 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-2d081e76-70c9-43b5-a458-e1b2b8cd32eb tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:26.785490 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2d081e76-70c9-43b5-a458-e1b2b8cd32eb tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:26.785974 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2d081e76-70c9-43b5-a458-e1b2b8cd32eb tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:26.786408 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2d081e76-70c9-43b5-a458-e1b2b8cd32eb tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:26.787093 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2d081e76-70c9-43b5-a458-e1b2b8cd32eb tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:26.787548 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2d081e76-70c9-43b5-a458-e1b2b8cd32eb tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:26.787989 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2d081e76-70c9-43b5-a458-e1b2b8cd32eb tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:26.865238 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-6fc188e8-3ac4-4866-8ad3-cfce6783fd74 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:26.866095 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-6fc188e8-3ac4-4866-8ad3-cfce6783fd74 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: ed538b97-8602-402c-8ef9-e25e6d71356a] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:26.872598 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6fc188e8-3ac4-4866-8ad3-cfce6783fd74 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:26.873080 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6fc188e8-3ac4-4866-8ad3-cfce6783fd74 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:26.873544 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6fc188e8-3ac4-4866-8ad3-cfce6783fd74 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:26.874345 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6fc188e8-3ac4-4866-8ad3-cfce6783fd74 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:26.874809 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6fc188e8-3ac4-4866-8ad3-cfce6783fd74 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:26.875241 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6fc188e8-3ac4-4866-8ad3-cfce6783fd74 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:26.915918 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-2d081e76-70c9-43b5-a458-e1b2b8cd32eb tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:26.923447 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-2d081e76-70c9-43b5-a458-e1b2b8cd32eb tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1677 microversion: 2.1 time: 0.148625 Aug 10 11:36:26.924043 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 212/425] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:26 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:26.937703 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-6fc188e8-3ac4-4866-8ad3-cfce6783fd74 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:26.945672 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-6fc188e8-3ac4-4866-8ad3-cfce6783fd74 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a" status: 200 len: 1192 microversion: 2.1 time: 0.084385 Aug 10 11:36:26.946225 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 214/426] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:26 2022] GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a => generated 1192 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:36:27.458538 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-417c402e-60d4-47dd-b8da-84a20fb61eec tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:27.460133 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-417c402e-60d4-47dd-b8da-84a20fb61eec tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:27.466522 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-417c402e-60d4-47dd-b8da-84a20fb61eec tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:27.467018 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-417c402e-60d4-47dd-b8da-84a20fb61eec tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:27.467705 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-417c402e-60d4-47dd-b8da-84a20fb61eec tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:27.468508 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-417c402e-60d4-47dd-b8da-84a20fb61eec tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:27.468969 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-417c402e-60d4-47dd-b8da-84a20fb61eec tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:27.469398 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-417c402e-60d4-47dd-b8da-84a20fb61eec tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:27.737031 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-b5a88ee0-8ddb-4a1e-8074-fec2777ee240 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:27.737545 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-b5a88ee0-8ddb-4a1e-8074-fec2777ee240 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 95b0dee9-162e-4edc-98e5-a6d36ce71ec1] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:27.744243 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b5a88ee0-8ddb-4a1e-8074-fec2777ee240 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:27.744551 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b5a88ee0-8ddb-4a1e-8074-fec2777ee240 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:27.745044 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b5a88ee0-8ddb-4a1e-8074-fec2777ee240 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:27.745765 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b5a88ee0-8ddb-4a1e-8074-fec2777ee240 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:27.746229 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b5a88ee0-8ddb-4a1e-8074-fec2777ee240 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:27.746665 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b5a88ee0-8ddb-4a1e-8074-fec2777ee240 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:27.774981 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-b5a88ee0-8ddb-4a1e-8074-fec2777ee240 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 95b0dee9-162e-4edc-98e5-a6d36ce71ec1] Going to try to terminate instance {{(pid=124682) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:36:28.076482 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-b5a88ee0-8ddb-4a1e-8074-fec2777ee240 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] 10.222.0.62 "DELETE /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1" status: 204 len: 0 microversion: 2.1 time: 0.342993 Aug 10 11:36:28.077121 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 215/427] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 10 11:36:27 2022] DELETE /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 11:36:28.082068 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-3d807b1a-4627-484f-8b53-348c3f7159b6 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:28.082808 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-3d807b1a-4627-484f-8b53-348c3f7159b6 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:28.086889 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-417c402e-60d4-47dd-b8da-84a20fb61eec tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:28.099227 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3d807b1a-4627-484f-8b53-348c3f7159b6 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:28.099787 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3d807b1a-4627-484f-8b53-348c3f7159b6 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:28.100852 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3d807b1a-4627-484f-8b53-348c3f7159b6 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:28.101474 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3d807b1a-4627-484f-8b53-348c3f7159b6 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:28.101921 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3d807b1a-4627-484f-8b53-348c3f7159b6 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:28.103588 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3d807b1a-4627-484f-8b53-348c3f7159b6 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:28.105340 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-417c402e-60d4-47dd-b8da-84a20fb61eec tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5" status: 200 len: 1734 microversion: 2.1 time: 0.650482 Aug 10 11:36:28.106122 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 213/428] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:27 2022] GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5 => generated 1734 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:36:28.112663 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-91830491-8b0f-4119-b764-19b62fd19101 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:28.113348 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-91830491-8b0f-4119-b764-19b62fd19101 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: ed538b97-8602-402c-8ef9-e25e6d71356a] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:28.120093 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-91830491-8b0f-4119-b764-19b62fd19101 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:28.126491 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-91830491-8b0f-4119-b764-19b62fd19101 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:28.126491 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-91830491-8b0f-4119-b764-19b62fd19101 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:28.126491 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-91830491-8b0f-4119-b764-19b62fd19101 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:28.126491 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-91830491-8b0f-4119-b764-19b62fd19101 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:28.126850 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-91830491-8b0f-4119-b764-19b62fd19101 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:28.216290 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-91830491-8b0f-4119-b764-19b62fd19101 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:28.224334 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-91830491-8b0f-4119-b764-19b62fd19101 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a" status: 200 len: 1210 microversion: 2.1 time: 0.116988 Aug 10 11:36:28.225839 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 214/429] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:28 2022] GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a => generated 1210 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:28.231080 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-8cd71a44-2d55-400c-807a-b05e004f812b tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:28.231887 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-8cd71a44-2d55-400c-807a-b05e004f812b tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 95b0dee9-162e-4edc-98e5-a6d36ce71ec1] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:28.239452 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8cd71a44-2d55-400c-807a-b05e004f812b tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:28.240108 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8cd71a44-2d55-400c-807a-b05e004f812b tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:28.240598 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8cd71a44-2d55-400c-807a-b05e004f812b tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:28.241467 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8cd71a44-2d55-400c-807a-b05e004f812b tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:28.241929 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8cd71a44-2d55-400c-807a-b05e004f812b tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:28.242385 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8cd71a44-2d55-400c-807a-b05e004f812b tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:28.277298 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-3d807b1a-4627-484f-8b53-348c3f7159b6 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:28.286083 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-3d807b1a-4627-484f-8b53-348c3f7159b6 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1677 microversion: 2.1 time: 0.207903 Aug 10 11:36:28.286676 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 216/430] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:28 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1677 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:28.455496 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-8cd71a44-2d55-400c-807a-b05e004f812b tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d35c64f3a748da9075622e08283aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8329fbf83b104200a04faaa9c454d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:28.463719 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-8cd71a44-2d55-400c-807a-b05e004f812b tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] 10.222.0.62 "GET /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1" status: 200 len: 1514 microversion: 2.1 time: 0.236656 Aug 10 11:36:28.464393 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 215/431] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:28 2022] GET /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1 => generated 1514 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:29.126579 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-4abc4f74-bf39-49cd-be9b-2d113b30e30c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:29.127235 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-4abc4f74-bf39-49cd-be9b-2d113b30e30c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:29.133929 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4abc4f74-bf39-49cd-be9b-2d113b30e30c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:29.134412 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4abc4f74-bf39-49cd-be9b-2d113b30e30c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:29.134841 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4abc4f74-bf39-49cd-be9b-2d113b30e30c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:29.135591 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4abc4f74-bf39-49cd-be9b-2d113b30e30c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:29.136064 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4abc4f74-bf39-49cd-be9b-2d113b30e30c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:29.136542 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4abc4f74-bf39-49cd-be9b-2d113b30e30c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:29.246256 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-8fbfe84a-45b5-4c07-a93e-8b85cd414097 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:29.246971 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-8fbfe84a-45b5-4c07-a93e-8b85cd414097 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: ed538b97-8602-402c-8ef9-e25e6d71356a] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:29.253427 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8fbfe84a-45b5-4c07-a93e-8b85cd414097 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:29.253909 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8fbfe84a-45b5-4c07-a93e-8b85cd414097 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:29.254349 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8fbfe84a-45b5-4c07-a93e-8b85cd414097 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:29.255048 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8fbfe84a-45b5-4c07-a93e-8b85cd414097 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:29.255503 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8fbfe84a-45b5-4c07-a93e-8b85cd414097 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:29.255996 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8fbfe84a-45b5-4c07-a93e-8b85cd414097 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:29.269968 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-4abc4f74-bf39-49cd-be9b-2d113b30e30c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:29.278768 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-4abc4f74-bf39-49cd-be9b-2d113b30e30c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5" status: 200 len: 1734 microversion: 2.1 time: 0.155919 Aug 10 11:36:29.279347 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 217/432] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:29 2022] GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:29.307811 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-7434a899-0179-4bed-8453-0809207e2a09 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:29.308445 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-7434a899-0179-4bed-8453-0809207e2a09 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:29.314354 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7434a899-0179-4bed-8453-0809207e2a09 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:29.314836 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7434a899-0179-4bed-8453-0809207e2a09 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:29.315282 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7434a899-0179-4bed-8453-0809207e2a09 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:29.315998 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7434a899-0179-4bed-8453-0809207e2a09 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:29.316509 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7434a899-0179-4bed-8453-0809207e2a09 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:29.316933 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7434a899-0179-4bed-8453-0809207e2a09 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:29.331512 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:36:29.389745 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-8fbfe84a-45b5-4c07-a93e-8b85cd414097 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:29.398530 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-8fbfe84a-45b5-4c07-a93e-8b85cd414097 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a" status: 200 len: 1278 microversion: 2.1 time: 0.156101 Aug 10 11:36:29.399111 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 216/433] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:29 2022] GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a => generated 1278 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:36:29.445067 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-7434a899-0179-4bed-8453-0809207e2a09 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:29.452467 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-7434a899-0179-4bed-8453-0809207e2a09 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1677 microversion: 2.1 time: 0.148524 Aug 10 11:36:29.453035 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 218/434] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:29 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:36:29.486038 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-de721d47-f0b3-4698-b1d7-8010c8b8b246 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:29.486646 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-de721d47-f0b3-4698-b1d7-8010c8b8b246 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 95b0dee9-162e-4edc-98e5-a6d36ce71ec1] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:29.492843 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-de721d47-f0b3-4698-b1d7-8010c8b8b246 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:29.493318 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-de721d47-f0b3-4698-b1d7-8010c8b8b246 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:29.493751 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-de721d47-f0b3-4698-b1d7-8010c8b8b246 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:29.494450 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-de721d47-f0b3-4698-b1d7-8010c8b8b246 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:29.494898 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-de721d47-f0b3-4698-b1d7-8010c8b8b246 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:29.495314 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-de721d47-f0b3-4698-b1d7-8010c8b8b246 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:29.624490 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-de721d47-f0b3-4698-b1d7-8010c8b8b246 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d35c64f3a748da9075622e08283aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8329fbf83b104200a04faaa9c454d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:29.632055 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-de721d47-f0b3-4698-b1d7-8010c8b8b246 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] 10.222.0.62 "GET /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1" status: 200 len: 1514 microversion: 2.1 time: 0.149808 Aug 10 11:36:29.632618 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 217/435] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:29 2022] GET /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:30.299799 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-f21dd955-05d4-45f5-9610-9581b9029e63 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:30.300431 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-f21dd955-05d4-45f5-9610-9581b9029e63 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:30.307270 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f21dd955-05d4-45f5-9610-9581b9029e63 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:30.307750 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f21dd955-05d4-45f5-9610-9581b9029e63 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:30.308215 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f21dd955-05d4-45f5-9610-9581b9029e63 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:30.308894 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f21dd955-05d4-45f5-9610-9581b9029e63 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:30.309344 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f21dd955-05d4-45f5-9610-9581b9029e63 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:30.309795 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f21dd955-05d4-45f5-9610-9581b9029e63 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:30.419076 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-5f2b0674-1254-47c4-ab0a-10bca6c7cedf tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:30.419694 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-5f2b0674-1254-47c4-ab0a-10bca6c7cedf tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: ed538b97-8602-402c-8ef9-e25e6d71356a] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:30.426009 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5f2b0674-1254-47c4-ab0a-10bca6c7cedf tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:30.426494 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5f2b0674-1254-47c4-ab0a-10bca6c7cedf tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:30.426933 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5f2b0674-1254-47c4-ab0a-10bca6c7cedf tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:30.427693 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5f2b0674-1254-47c4-ab0a-10bca6c7cedf tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:30.428366 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5f2b0674-1254-47c4-ab0a-10bca6c7cedf tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:30.428793 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5f2b0674-1254-47c4-ab0a-10bca6c7cedf tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:30.441052 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-f21dd955-05d4-45f5-9610-9581b9029e63 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:30.450076 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-f21dd955-05d4-45f5-9610-9581b9029e63 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5" status: 200 len: 1734 microversion: 2.1 time: 0.154151 Aug 10 11:36:30.450642 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 219/436] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:30 2022] GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:30.474465 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-bdbb136b-e79b-4e6d-ac31-ab312ab8fb78 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:30.475179 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-bdbb136b-e79b-4e6d-ac31-ab312ab8fb78 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:30.481236 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bdbb136b-e79b-4e6d-ac31-ab312ab8fb78 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:30.481721 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bdbb136b-e79b-4e6d-ac31-ab312ab8fb78 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:30.482159 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bdbb136b-e79b-4e6d-ac31-ab312ab8fb78 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:30.482842 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bdbb136b-e79b-4e6d-ac31-ab312ab8fb78 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:30.483298 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bdbb136b-e79b-4e6d-ac31-ab312ab8fb78 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:30.483721 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bdbb136b-e79b-4e6d-ac31-ab312ab8fb78 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:30.566005 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-5f2b0674-1254-47c4-ab0a-10bca6c7cedf tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:30.574718 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-5f2b0674-1254-47c4-ab0a-10bca6c7cedf tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a" status: 200 len: 1278 microversion: 2.1 time: 0.159365 Aug 10 11:36:30.575733 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 218/437] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:30 2022] GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a => generated 1278 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:30.620400 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-bdbb136b-e79b-4e6d-ac31-ab312ab8fb78 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:30.632888 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-bdbb136b-e79b-4e6d-ac31-ab312ab8fb78 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1677 microversion: 2.1 time: 0.157531 Aug 10 11:36:30.632888 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 220/438] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:30 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:36:30.655274 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-6837c057-7dc2-461e-af95-26758d835300 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:30.655934 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-6837c057-7dc2-461e-af95-26758d835300 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 95b0dee9-162e-4edc-98e5-a6d36ce71ec1] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:30.663025 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6837c057-7dc2-461e-af95-26758d835300 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:30.663502 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6837c057-7dc2-461e-af95-26758d835300 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:30.663937 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6837c057-7dc2-461e-af95-26758d835300 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:30.664651 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6837c057-7dc2-461e-af95-26758d835300 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:30.665111 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6837c057-7dc2-461e-af95-26758d835300 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:30.665530 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6837c057-7dc2-461e-af95-26758d835300 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:30.793390 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-6837c057-7dc2-461e-af95-26758d835300 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d35c64f3a748da9075622e08283aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8329fbf83b104200a04faaa9c454d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:30.800713 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-6837c057-7dc2-461e-af95-26758d835300 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] 10.222.0.62 "GET /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1" status: 200 len: 1514 microversion: 2.1 time: 0.151530 Aug 10 11:36:30.801281 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 219/439] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:30 2022] GET /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:31.471793 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-aeeb71ab-cc76-4af4-9734-e093d1ad170f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:31.472353 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-aeeb71ab-cc76-4af4-9734-e093d1ad170f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:31.474220 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=2 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:36:31.475482 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=6 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:36:31.481324 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-aeeb71ab-cc76-4af4-9734-e093d1ad170f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:31.481808 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-aeeb71ab-cc76-4af4-9734-e093d1ad170f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:31.482242 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-aeeb71ab-cc76-4af4-9734-e093d1ad170f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:31.482952 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-aeeb71ab-cc76-4af4-9734-e093d1ad170f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:31.483401 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-aeeb71ab-cc76-4af4-9734-e093d1ad170f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:31.483824 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-aeeb71ab-cc76-4af4-9734-e093d1ad170f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:31.595570 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-5a33d7f9-e3c8-429a-ac46-8415dff5c699 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:31.596212 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-5a33d7f9-e3c8-429a-ac46-8415dff5c699 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: ed538b97-8602-402c-8ef9-e25e6d71356a] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:31.598214 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=2 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:36:31.607384 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5a33d7f9-e3c8-429a-ac46-8415dff5c699 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:31.607999 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5a33d7f9-e3c8-429a-ac46-8415dff5c699 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:31.608426 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5a33d7f9-e3c8-429a-ac46-8415dff5c699 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:31.611658 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5a33d7f9-e3c8-429a-ac46-8415dff5c699 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:31.611658 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5a33d7f9-e3c8-429a-ac46-8415dff5c699 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:31.611658 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5a33d7f9-e3c8-429a-ac46-8415dff5c699 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:31.613314 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-aeeb71ab-cc76-4af4-9734-e093d1ad170f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:31.622254 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-aeeb71ab-cc76-4af4-9734-e093d1ad170f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5" status: 200 len: 1734 microversion: 2.1 time: 0.154342 Aug 10 11:36:31.623270 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 221/440] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:31 2022] GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:31.650152 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-ae20207d-8b5c-4139-9055-3c1e0ba845a7 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:31.650863 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-ae20207d-8b5c-4139-9055-3c1e0ba845a7 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:31.657136 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ae20207d-8b5c-4139-9055-3c1e0ba845a7 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:31.657856 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ae20207d-8b5c-4139-9055-3c1e0ba845a7 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:31.658367 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ae20207d-8b5c-4139-9055-3c1e0ba845a7 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:31.659153 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ae20207d-8b5c-4139-9055-3c1e0ba845a7 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:31.659687 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ae20207d-8b5c-4139-9055-3c1e0ba845a7 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:31.660216 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ae20207d-8b5c-4139-9055-3c1e0ba845a7 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:31.810076 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-ae20207d-8b5c-4139-9055-3c1e0ba845a7 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:31.817772 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-ae20207d-8b5c-4139-9055-3c1e0ba845a7 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1677 microversion: 2.1 time: 0.172282 Aug 10 11:36:31.818989 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 222/441] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:31 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1677 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:31.823417 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-b44be582-a77c-416c-b24a-23ee62cc330d tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:31.824040 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-b44be582-a77c-416c-b24a-23ee62cc330d tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 95b0dee9-162e-4edc-98e5-a6d36ce71ec1] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:31.830061 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b44be582-a77c-416c-b24a-23ee62cc330d tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:31.830560 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b44be582-a77c-416c-b24a-23ee62cc330d tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:31.830969 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b44be582-a77c-416c-b24a-23ee62cc330d tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:31.831650 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b44be582-a77c-416c-b24a-23ee62cc330d tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:31.832223 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b44be582-a77c-416c-b24a-23ee62cc330d tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:31.832543 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b44be582-a77c-416c-b24a-23ee62cc330d tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:31.907188 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-5a33d7f9-e3c8-429a-ac46-8415dff5c699 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:31.916323 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-5a33d7f9-e3c8-429a-ac46-8415dff5c699 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a" status: 200 len: 1278 microversion: 2.1 time: 0.324205 Aug 10 11:36:31.916687 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 220/442] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:31 2022] GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a => generated 1278 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:36:31.984053 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b44be582-a77c-416c-b24a-23ee62cc330d tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d35c64f3a748da9075622e08283aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8329fbf83b104200a04faaa9c454d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:31.994095 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-b44be582-a77c-416c-b24a-23ee62cc330d tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] 10.222.0.62 "GET /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1" status: 200 len: 1514 microversion: 2.1 time: 0.173954 Aug 10 11:36:32.001744 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 223/443] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:31 2022] GET /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1 => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:32.575635 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-2cc30e85-b933-472f-b639-1deb2b699da5 req-dea9e0d1-65b6-4c18-a667-347a2579eaec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed538b97-8602-402c-8ef9-e25e6d71356a", "tag": "28ec2bce-b922-4871-b61a-a1d936982071"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:36:32.585832 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-2cc30e85-b933-472f-b639-1deb2b699da5 req-dea9e0d1-65b6-4c18-a667-347a2579eaec service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:32.586444 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-2cc30e85-b933-472f-b639-1deb2b699da5 req-dea9e0d1-65b6-4c18-a667-347a2579eaec service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:32.586943 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-2cc30e85-b933-472f-b639-1deb2b699da5 req-dea9e0d1-65b6-4c18-a667-347a2579eaec service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:32.598655 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-2cc30e85-b933-472f-b639-1deb2b699da5 req-dea9e0d1-65b6-4c18-a667-347a2579eaec service nova] Creating event network-changed:28ec2bce-b922-4871-b61a-a1d936982071 for instance ed538b97-8602-402c-8ef9-e25e6d71356a on hv-cinder-85272 Aug 10 11:36:32.611194 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-2cc30e85-b933-472f-b639-1deb2b699da5 req-dea9e0d1-65b6-4c18-a667-347a2579eaec service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046283 Aug 10 11:36:32.612331 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 221/444] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:36:32.645608 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-fd94be79-f53e-4140-8d6f-187597570e36 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:32.646225 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-fd94be79-f53e-4140-8d6f-187597570e36 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:32.655060 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fd94be79-f53e-4140-8d6f-187597570e36 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:32.655776 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fd94be79-f53e-4140-8d6f-187597570e36 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:32.657016 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fd94be79-f53e-4140-8d6f-187597570e36 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:32.657744 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fd94be79-f53e-4140-8d6f-187597570e36 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:32.668178 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fd94be79-f53e-4140-8d6f-187597570e36 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:32.669465 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fd94be79-f53e-4140-8d6f-187597570e36 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:32.845868 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-880694c5-56fe-4e24-bb8e-12b89b0a0487 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:32.845868 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-880694c5-56fe-4e24-bb8e-12b89b0a0487 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:32.851685 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-880694c5-56fe-4e24-bb8e-12b89b0a0487 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:32.852311 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-880694c5-56fe-4e24-bb8e-12b89b0a0487 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:32.853270 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-880694c5-56fe-4e24-bb8e-12b89b0a0487 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:32.854188 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-880694c5-56fe-4e24-bb8e-12b89b0a0487 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:32.854856 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-880694c5-56fe-4e24-bb8e-12b89b0a0487 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:32.855513 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-880694c5-56fe-4e24-bb8e-12b89b0a0487 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:32.907828 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-fd94be79-f53e-4140-8d6f-187597570e36 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:32.923177 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-fd94be79-f53e-4140-8d6f-187597570e36 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5" status: 200 len: 1734 microversion: 2.1 time: 0.282220 Aug 10 11:36:32.923771 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 224/445] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:32 2022] GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5 => generated 1734 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:32.928558 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-d9b48523-bf15-4c61-83de-b17b58acf902 req-60b67f6f-b3fe-4a4c-a255-fc4989cb4a98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95b0dee9-162e-4edc-98e5-a6d36ce71ec1", "name": "network-vif-deleted", "tag": "484483b2-57e1-4178-9ceb-6fe32dbb0e0b"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:36:32.943054 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-d9b48523-bf15-4c61-83de-b17b58acf902 req-60b67f6f-b3fe-4a4c-a255-fc4989cb4a98 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:32.944166 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-d9b48523-bf15-4c61-83de-b17b58acf902 req-60b67f6f-b3fe-4a4c-a255-fc4989cb4a98 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:32.944615 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-d9b48523-bf15-4c61-83de-b17b58acf902 req-60b67f6f-b3fe-4a4c-a255-fc4989cb4a98 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:32.958686 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-d9b48523-bf15-4c61-83de-b17b58acf902 req-60b67f6f-b3fe-4a4c-a255-fc4989cb4a98 service nova] Creating event network-vif-deleted:484483b2-57e1-4178-9ceb-6fe32dbb0e0b for instance 95b0dee9-162e-4edc-98e5-a6d36ce71ec1 on hv-cinder-85272 Aug 10 11:36:32.964797 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-d9b48523-bf15-4c61-83de-b17b58acf902 req-60b67f6f-b3fe-4a4c-a255-fc4989cb4a98 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039640 Aug 10 11:36:32.971929 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 225/446] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:36:32.975895 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-264dd98a-0d27-4419-99a1-a2d10b968280 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:32.976698 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-264dd98a-0d27-4419-99a1-a2d10b968280 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: ed538b97-8602-402c-8ef9-e25e6d71356a] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:32.983391 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-264dd98a-0d27-4419-99a1-a2d10b968280 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:32.984162 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-264dd98a-0d27-4419-99a1-a2d10b968280 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:32.985225 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-264dd98a-0d27-4419-99a1-a2d10b968280 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:32.986127 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-264dd98a-0d27-4419-99a1-a2d10b968280 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:32.986844 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-264dd98a-0d27-4419-99a1-a2d10b968280 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:32.987592 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-264dd98a-0d27-4419-99a1-a2d10b968280 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:33.122034 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-880694c5-56fe-4e24-bb8e-12b89b0a0487 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:33.134499 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-880694c5-56fe-4e24-bb8e-12b89b0a0487 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1677 microversion: 2.1 time: 0.295148 Aug 10 11:36:33.135581 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 222/447] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:32 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1677 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:33.157545 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-69952629-b95b-4d28-ae17-f4aa7ec07a38 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:33.158980 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-69952629-b95b-4d28-ae17-f4aa7ec07a38 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 95b0dee9-162e-4edc-98e5-a6d36ce71ec1] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:33.164423 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-264dd98a-0d27-4419-99a1-a2d10b968280 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:33.173013 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-264dd98a-0d27-4419-99a1-a2d10b968280 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a" status: 200 len: 1266 microversion: 2.1 time: 0.203413 Aug 10 11:36:33.173595 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 226/448] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:32 2022] GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:33.175746 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-69952629-b95b-4d28-ae17-f4aa7ec07a38 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:33.178389 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-69952629-b95b-4d28-ae17-f4aa7ec07a38 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:33.178912 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-69952629-b95b-4d28-ae17-f4aa7ec07a38 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:33.179723 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-69952629-b95b-4d28-ae17-f4aa7ec07a38 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:33.180269 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-69952629-b95b-4d28-ae17-f4aa7ec07a38 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:33.180918 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-69952629-b95b-4d28-ae17-f4aa7ec07a38 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:33.215517 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=100 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:36:33.228222 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-69952629-b95b-4d28-ae17-f4aa7ec07a38 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:33.228712 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-69952629-b95b-4d28-ae17-f4aa7ec07a38 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:33.229485 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-69952629-b95b-4d28-ae17-f4aa7ec07a38 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:33.229933 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.objects.instance [None req-69952629-b95b-4d28-ae17-f4aa7ec07a38 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lazy-loading 'fault' on Instance uuid 95b0dee9-162e-4edc-98e5-a6d36ce71ec1 {{(pid=124683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:36:33.281626 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-69952629-b95b-4d28-ae17-f4aa7ec07a38 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d35c64f3a748da9075622e08283aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8329fbf83b104200a04faaa9c454d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:33.292488 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-69952629-b95b-4d28-ae17-f4aa7ec07a38 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] 10.222.0.62 "GET /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1" status: 200 len: 1309 microversion: 2.1 time: 0.155555 Aug 10 11:36:33.293468 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 223/449] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:33 2022] GET /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1 => generated 1309 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:33.947289 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-3eef14ce-42cb-4bd5-8cb0-9eb4b53cfdef tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:33.947896 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-3eef14ce-42cb-4bd5-8cb0-9eb4b53cfdef tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:33.955144 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3eef14ce-42cb-4bd5-8cb0-9eb4b53cfdef tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:33.955701 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3eef14ce-42cb-4bd5-8cb0-9eb4b53cfdef tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:33.956191 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3eef14ce-42cb-4bd5-8cb0-9eb4b53cfdef tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:33.956909 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3eef14ce-42cb-4bd5-8cb0-9eb4b53cfdef tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:33.957385 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3eef14ce-42cb-4bd5-8cb0-9eb4b53cfdef tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:33.957811 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3eef14ce-42cb-4bd5-8cb0-9eb4b53cfdef tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:34.089301 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-3eef14ce-42cb-4bd5-8cb0-9eb4b53cfdef tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:34.097207 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-3eef14ce-42cb-4bd5-8cb0-9eb4b53cfdef tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5" status: 200 len: 1734 microversion: 2.1 time: 0.153880 Aug 10 11:36:34.097777 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 227/450] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:33 2022] GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:34.156331 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-ffd76b49-54c5-48bd-9231-fbe4ff1d9788 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:34.156977 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-ffd76b49-54c5-48bd-9231-fbe4ff1d9788 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:34.163273 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ffd76b49-54c5-48bd-9231-fbe4ff1d9788 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:34.164402 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ffd76b49-54c5-48bd-9231-fbe4ff1d9788 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:34.164956 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ffd76b49-54c5-48bd-9231-fbe4ff1d9788 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:34.165650 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ffd76b49-54c5-48bd-9231-fbe4ff1d9788 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:34.166120 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ffd76b49-54c5-48bd-9231-fbe4ff1d9788 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:34.166551 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ffd76b49-54c5-48bd-9231-fbe4ff1d9788 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:34.200410 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-ac2feacc-e849-48be-a404-2121a365801b tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:34.201017 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-ac2feacc-e849-48be-a404-2121a365801b tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: ed538b97-8602-402c-8ef9-e25e6d71356a] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:34.207025 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ac2feacc-e849-48be-a404-2121a365801b tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:34.207519 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ac2feacc-e849-48be-a404-2121a365801b tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:34.207979 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ac2feacc-e849-48be-a404-2121a365801b tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:34.208681 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ac2feacc-e849-48be-a404-2121a365801b tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:34.209141 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ac2feacc-e849-48be-a404-2121a365801b tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:34.209568 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ac2feacc-e849-48be-a404-2121a365801b tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:34.296068 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-ffd76b49-54c5-48bd-9231-fbe4ff1d9788 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:34.303325 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-ffd76b49-54c5-48bd-9231-fbe4ff1d9788 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1654 microversion: 2.1 time: 0.150916 Aug 10 11:36:34.303894 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 224/451] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:34 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1654 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:34.321446 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-89317549-9967-46d5-986f-eb2daac7270d tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:34.322075 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-89317549-9967-46d5-986f-eb2daac7270d tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 95b0dee9-162e-4edc-98e5-a6d36ce71ec1] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:34.327886 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-89317549-9967-46d5-986f-eb2daac7270d tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:34.328397 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-89317549-9967-46d5-986f-eb2daac7270d tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:34.328830 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-89317549-9967-46d5-986f-eb2daac7270d tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:34.329515 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-89317549-9967-46d5-986f-eb2daac7270d tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:34.329963 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-89317549-9967-46d5-986f-eb2daac7270d tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:34.330381 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-89317549-9967-46d5-986f-eb2daac7270d tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:34.339311 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-ac2feacc-e849-48be-a404-2121a365801b tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:34.344057 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-89317549-9967-46d5-986f-eb2daac7270d tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] HTTP exception thrown: Instance 95b0dee9-162e-4edc-98e5-a6d36ce71ec1 could not be found. Aug 10 11:36:34.345779 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-89317549-9967-46d5-986f-eb2daac7270d tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Request method failure captured: Aug 10 11:36:34.345779 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: request: GET /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1 HTTP/1.1 Aug 10 11:36:34.345779 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept: application/json Aug 10 11:36:34.345779 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Aug 10 11:36:34.345779 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Connection: close Aug 10 11:36:34.345779 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Length: 0 Aug 10 11:36:34.345779 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Type: application/json Aug 10 11:36:34.345779 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Host: 10.222.0.62 Aug 10 11:36:34.345779 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Aug 10 11:36:34.345779 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.11 Aug 10 11:36:34.345779 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABi85fpIcS-Eayg2FKbrNWK8Xm0pR4Yq5PX62h2RWu79-D_Nlxzq9hvBVhmVLuZbW1kOjenOakd35zPxQmVBSwFfMHHLpF-_VSKVqiS2lRYA6Li2lt__ZEuiLtsfr5-wN7Y0aFnMyD3Chipn8jSDav1oS8XQLSdSWQ4fG6bxb8mplDpVyE Aug 10 11:36:34.345779 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Aug 10 11:36:34.345779 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Aug 10 11:36:34.345779 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Aug 10 11:36:34.345779 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Aug 10 11:36:34.345779 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Aug 10 11:36:34.345779 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Aug 10 11:36:34.345779 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Id: 8329fbf83b104200a04faaa9c454d708 Aug 10 11:36:34.345779 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-VolumesSnapshotTestJSON-466872305 Aug 10 11:36:34.345779 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Role: member,reader Aug 10 11:36:34.345779 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Aug 10 11:36:34.347393 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/8329fbf83b104200a04faaa9c454d708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_8329fbf83b104200a04faaa9c454d708", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8329fbf83b104200a04faaa9c454d708"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8329fbf83b104200a04faaa9c454d708"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:36:34.347393 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-VolumesSnapshotTestJSON-466872305 Aug 10 11:36:34.347393 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Id: 8329fbf83b104200a04faaa9c454d708 Aug 10 11:36:34.347393 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-466872305 Aug 10 11:36:34.347393 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User: tempest-VolumesSnapshotTestJSON-466872305-project Aug 10 11:36:34.347393 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Aug 10 11:36:34.347393 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Aug 10 11:36:34.347393 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Id: 24d35c64f3a748da9075622e08283aba Aug 10 11:36:34.347393 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-VolumesSnapshotTestJSON-466872305-project Aug 10 11:36:34.347393 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: method: > Aug 10 11:36:34.347393 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: exception: Instance 95b0dee9-162e-4edc-98e5-a6d36ce71ec1 could not be found. Aug 10 11:36:34.347393 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: action_args: {'id': '95b0dee9-162e-4edc-98e5-a6d36ce71ec1'} Aug 10 11:36:34.352176 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:36:34.352176 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:36:34.352176 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:36:34.352176 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:36:34.352176 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:36:34.352176 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:36:34.352176 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:36:34.352176 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:36:34.352176 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:36:34.352176 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:36:34.352176 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95b0dee9-162e-4edc-98e5-a6d36ce71ec1 could not be found. Aug 10 11:36:34.352176 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:36:34.352176 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:36:34.352176 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:36:34.352176 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:36:34.352176 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:36:34.352176 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:36:34.352176 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:36:34.352176 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:36:34.352176 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:36:34.353359 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:36:34.353359 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:36:34.353359 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:36:34.353359 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:36:34.353359 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:36:34.353359 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:36:34.353359 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:36:34.353359 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95b0dee9-162e-4edc-98e5-a6d36ce71ec1 could not be found. Aug 10 11:36:34.353359 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:36:34.353359 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:36:34.353359 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:36:34.353359 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:36:34.353359 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:36:34.353359 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:36:34.353359 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:36:34.353359 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:36:34.353359 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95b0dee9-162e-4edc-98e5-a6d36ce71ec1 could not be found. Aug 10 11:36:34.353359 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:36:34.354399 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-89317549-9967-46d5-986f-eb2daac7270d tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Returning 404 to user: Instance 95b0dee9-162e-4edc-98e5-a6d36ce71ec1 could not be found. {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:36:34.354473 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-ac2feacc-e849-48be-a404-2121a365801b tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a" status: 200 len: 1266 microversion: 2.1 time: 0.150333 Aug 10 11:36:34.354560 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-89317549-9967-46d5-986f-eb2daac7270d tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] 10.222.0.62 "GET /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1" status: 404 len: 111 microversion: 2.1 time: 0.030022 Aug 10 11:36:34.354560 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 225/452] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:34 2022] GET /compute/v2.1/servers/95b0dee9-162e-4edc-98e5-a6d36ce71ec1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:36:34.354695 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 228/453] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:34 2022] GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:36:34.354776 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f39d6ba0-5c24-4910-9557-c971704d9dab tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:36:34.366462 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f39d6ba0-5c24-4910-9557-c971704d9dab tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:34.366462 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f39d6ba0-5c24-4910-9557-c971704d9dab tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:34.366462 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f39d6ba0-5c24-4910-9557-c971704d9dab tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:34.387310 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-f39d6ba0-5c24-4910-9557-c971704d9dab tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Going to try to start instance {{(pid=124683) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 10 11:36:34.593661 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-f39d6ba0-5c24-4910-9557-c971704d9dab tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "POST /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3/action" status: 202 len: 0 microversion: 2.1 time: 0.244344 Aug 10 11:36:34.594259 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 226/454] 10.222.0.62 () {60 vars in 1278 bytes} [Wed Aug 10 11:36:34 2022] POST /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:36:34.603750 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-c40cb065-0729-4cd1-87dc-d3e7f794c65a tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:34.604479 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-c40cb065-0729-4cd1-87dc-d3e7f794c65a tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:34.610467 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c40cb065-0729-4cd1-87dc-d3e7f794c65a tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:34.610936 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c40cb065-0729-4cd1-87dc-d3e7f794c65a tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:34.611372 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c40cb065-0729-4cd1-87dc-d3e7f794c65a tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:34.612085 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c40cb065-0729-4cd1-87dc-d3e7f794c65a tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:34.612537 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c40cb065-0729-4cd1-87dc-d3e7f794c65a tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:34.612959 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c40cb065-0729-4cd1-87dc-d3e7f794c65a tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:34.761161 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c40cb065-0729-4cd1-87dc-d3e7f794c65a tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:34.770183 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-c40cb065-0729-4cd1-87dc-d3e7f794c65a tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1663 microversion: 2.1 time: 0.171413 Aug 10 11:36:34.771430 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 229/455] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:34 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1663 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:35.119432 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-57970ad3-b06f-4ce5-b60d-7d78a9e4cd64 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:35.120314 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-57970ad3-b06f-4ce5-b60d-7d78a9e4cd64 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:35.126280 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-57970ad3-b06f-4ce5-b60d-7d78a9e4cd64 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:35.126761 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-57970ad3-b06f-4ce5-b60d-7d78a9e4cd64 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:35.127191 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-57970ad3-b06f-4ce5-b60d-7d78a9e4cd64 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:35.127884 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-57970ad3-b06f-4ce5-b60d-7d78a9e4cd64 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:35.129044 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-57970ad3-b06f-4ce5-b60d-7d78a9e4cd64 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:35.129437 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-57970ad3-b06f-4ce5-b60d-7d78a9e4cd64 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:35.327657 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-57970ad3-b06f-4ce5-b60d-7d78a9e4cd64 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:35.335531 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-57970ad3-b06f-4ce5-b60d-7d78a9e4cd64 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5" status: 200 len: 1734 microversion: 2.1 time: 0.220721 Aug 10 11:36:35.336182 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 227/456] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:35 2022] GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5 => generated 1734 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:35.369348 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-ef772e0e-f58b-43cb-a461-95c078c04bc4 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:35.369992 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-ef772e0e-f58b-43cb-a461-95c078c04bc4 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: ed538b97-8602-402c-8ef9-e25e6d71356a] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:35.376435 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ef772e0e-f58b-43cb-a461-95c078c04bc4 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:35.376958 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ef772e0e-f58b-43cb-a461-95c078c04bc4 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:35.377376 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ef772e0e-f58b-43cb-a461-95c078c04bc4 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:35.378086 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ef772e0e-f58b-43cb-a461-95c078c04bc4 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:35.378539 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ef772e0e-f58b-43cb-a461-95c078c04bc4 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:35.378963 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ef772e0e-f58b-43cb-a461-95c078c04bc4 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:35.507334 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-ef772e0e-f58b-43cb-a461-95c078c04bc4 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:35.515287 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-ef772e0e-f58b-43cb-a461-95c078c04bc4 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a" status: 200 len: 1266 microversion: 2.1 time: 0.150666 Aug 10 11:36:35.516137 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 230/457] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:35 2022] GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:35.796365 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-01476653-e9c9-4112-b825-9378091d4f28 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:35.796980 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-01476653-e9c9-4112-b825-9378091d4f28 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:35.802835 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-01476653-e9c9-4112-b825-9378091d4f28 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:35.803317 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-01476653-e9c9-4112-b825-9378091d4f28 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:35.803752 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-01476653-e9c9-4112-b825-9378091d4f28 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:35.804461 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-01476653-e9c9-4112-b825-9378091d4f28 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:35.804918 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-01476653-e9c9-4112-b825-9378091d4f28 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:35.805340 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-01476653-e9c9-4112-b825-9378091d4f28 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:35.932607 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-01476653-e9c9-4112-b825-9378091d4f28 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:35.940055 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-01476653-e9c9-4112-b825-9378091d4f28 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1663 microversion: 2.1 time: 0.147453 Aug 10 11:36:35.940617 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 228/458] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:35 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1663 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:36:36.356597 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-833d6360-23f8-49a5-920e-5b0b8d0f14de tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:36.357217 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-833d6360-23f8-49a5-920e-5b0b8d0f14de tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:36.363124 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-833d6360-23f8-49a5-920e-5b0b8d0f14de tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:36.363604 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-833d6360-23f8-49a5-920e-5b0b8d0f14de tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:36.364067 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-833d6360-23f8-49a5-920e-5b0b8d0f14de tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:36.364748 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-833d6360-23f8-49a5-920e-5b0b8d0f14de tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:36.365203 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-833d6360-23f8-49a5-920e-5b0b8d0f14de tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:36.365627 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-833d6360-23f8-49a5-920e-5b0b8d0f14de tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:36.490641 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-833d6360-23f8-49a5-920e-5b0b8d0f14de tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:36.499507 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-833d6360-23f8-49a5-920e-5b0b8d0f14de tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5" status: 200 len: 1734 microversion: 2.1 time: 0.146831 Aug 10 11:36:36.500092 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 231/459] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:36 2022] GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5 => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:36.535811 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-34312a81-990b-4ab1-8fc9-1c74da828bd2 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:36.536459 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-34312a81-990b-4ab1-8fc9-1c74da828bd2 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: ed538b97-8602-402c-8ef9-e25e6d71356a] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:36.543643 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-34312a81-990b-4ab1-8fc9-1c74da828bd2 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:36.544165 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-34312a81-990b-4ab1-8fc9-1c74da828bd2 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:36.544605 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-34312a81-990b-4ab1-8fc9-1c74da828bd2 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:36.545292 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-34312a81-990b-4ab1-8fc9-1c74da828bd2 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:36.545742 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-34312a81-990b-4ab1-8fc9-1c74da828bd2 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:36.546164 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-34312a81-990b-4ab1-8fc9-1c74da828bd2 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:36.675800 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-34312a81-990b-4ab1-8fc9-1c74da828bd2 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:36.683951 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-34312a81-990b-4ab1-8fc9-1c74da828bd2 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a" status: 200 len: 1266 microversion: 2.1 time: 0.151944 Aug 10 11:36:36.684538 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 229/460] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:36 2022] GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:36.965082 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-85728c55-fae9-44bd-a6a2-205ed3c9c067 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:36.965404 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-85728c55-fae9-44bd-a6a2-205ed3c9c067 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:36.972582 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-85728c55-fae9-44bd-a6a2-205ed3c9c067 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:36.977257 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-85728c55-fae9-44bd-a6a2-205ed3c9c067 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:36.977257 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-85728c55-fae9-44bd-a6a2-205ed3c9c067 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:36.977257 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-85728c55-fae9-44bd-a6a2-205ed3c9c067 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:36.977257 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-85728c55-fae9-44bd-a6a2-205ed3c9c067 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:36.978580 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-85728c55-fae9-44bd-a6a2-205ed3c9c067 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:37.118420 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-85728c55-fae9-44bd-a6a2-205ed3c9c067 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:37.126253 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-85728c55-fae9-44bd-a6a2-205ed3c9c067 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1663 microversion: 2.1 time: 0.168820 Aug 10 11:36:37.126819 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 232/461] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:36 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1663 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:37.520781 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-5994538e-d0ca-440e-9e81-09ef382ae88b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:37.521393 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-5994538e-d0ca-440e-9e81-09ef382ae88b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:37.527296 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5994538e-d0ca-440e-9e81-09ef382ae88b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:37.527774 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5994538e-d0ca-440e-9e81-09ef382ae88b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:37.528237 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5994538e-d0ca-440e-9e81-09ef382ae88b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:37.528922 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5994538e-d0ca-440e-9e81-09ef382ae88b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:37.529376 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5994538e-d0ca-440e-9e81-09ef382ae88b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:37.529800 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5994538e-d0ca-440e-9e81-09ef382ae88b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:37.666450 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-5994538e-d0ca-440e-9e81-09ef382ae88b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:37.674343 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-5994538e-d0ca-440e-9e81-09ef382ae88b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5" status: 200 len: 1734 microversion: 2.1 time: 0.157419 Aug 10 11:36:37.674908 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 230/462] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:37 2022] GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:37.704348 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-8d98e253-455f-40f7-a352-fc1acf66416f tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:37.704958 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-8d98e253-455f-40f7-a352-fc1acf66416f tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: ed538b97-8602-402c-8ef9-e25e6d71356a] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:37.711216 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8d98e253-455f-40f7-a352-fc1acf66416f tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:37.711692 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8d98e253-455f-40f7-a352-fc1acf66416f tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:37.712833 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8d98e253-455f-40f7-a352-fc1acf66416f tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:37.713483 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8d98e253-455f-40f7-a352-fc1acf66416f tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:37.713938 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8d98e253-455f-40f7-a352-fc1acf66416f tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:37.714607 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8d98e253-455f-40f7-a352-fc1acf66416f tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:37.844456 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-8d98e253-455f-40f7-a352-fc1acf66416f tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:37.851819 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-8d98e253-455f-40f7-a352-fc1acf66416f tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a" status: 200 len: 1266 microversion: 2.1 time: 0.151224 Aug 10 11:36:37.852404 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 233/463] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:37 2022] GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:38.146771 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-ef3a394d-350e-4766-96fa-15409bd39b13 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:38.147443 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-ef3a394d-350e-4766-96fa-15409bd39b13 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:38.154118 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ef3a394d-350e-4766-96fa-15409bd39b13 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:38.154812 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ef3a394d-350e-4766-96fa-15409bd39b13 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:38.155434 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ef3a394d-350e-4766-96fa-15409bd39b13 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:38.156474 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ef3a394d-350e-4766-96fa-15409bd39b13 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:38.157087 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ef3a394d-350e-4766-96fa-15409bd39b13 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:38.157508 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ef3a394d-350e-4766-96fa-15409bd39b13 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:38.284747 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-ef3a394d-350e-4766-96fa-15409bd39b13 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:38.293232 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-ef3a394d-350e-4766-96fa-15409bd39b13 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1663 microversion: 2.1 time: 0.150229 Aug 10 11:36:38.293810 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 231/464] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:38 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1663 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:38.694829 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-ed1fa140-7edf-4713-a9d5-2f7a100c404f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:38.695671 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-ed1fa140-7edf-4713-a9d5-2f7a100c404f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:38.702369 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ed1fa140-7edf-4713-a9d5-2f7a100c404f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:38.702858 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ed1fa140-7edf-4713-a9d5-2f7a100c404f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:38.703300 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ed1fa140-7edf-4713-a9d5-2f7a100c404f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:38.704051 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ed1fa140-7edf-4713-a9d5-2f7a100c404f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:38.704512 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ed1fa140-7edf-4713-a9d5-2f7a100c404f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:38.705077 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ed1fa140-7edf-4713-a9d5-2f7a100c404f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:38.844274 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-ed1fa140-7edf-4713-a9d5-2f7a100c404f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:38.854007 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-ed1fa140-7edf-4713-a9d5-2f7a100c404f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5" status: 200 len: 1734 microversion: 2.1 time: 0.163007 Aug 10 11:36:38.855113 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 234/465] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:38 2022] GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:38.872262 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-b0e09344-2c26-4d47-9fb7-ac9b51e56979 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:38.872870 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-b0e09344-2c26-4d47-9fb7-ac9b51e56979 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: ed538b97-8602-402c-8ef9-e25e6d71356a] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:38.880270 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b0e09344-2c26-4d47-9fb7-ac9b51e56979 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:38.880757 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b0e09344-2c26-4d47-9fb7-ac9b51e56979 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:38.881190 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b0e09344-2c26-4d47-9fb7-ac9b51e56979 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:38.881881 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b0e09344-2c26-4d47-9fb7-ac9b51e56979 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:38.882726 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b0e09344-2c26-4d47-9fb7-ac9b51e56979 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:38.883670 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b0e09344-2c26-4d47-9fb7-ac9b51e56979 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:39.065050 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-b0e09344-2c26-4d47-9fb7-ac9b51e56979 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:39.072916 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-b0e09344-2c26-4d47-9fb7-ac9b51e56979 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a" status: 200 len: 1266 microversion: 2.1 time: 0.204994 Aug 10 11:36:39.073555 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 232/466] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:38 2022] GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:39.316728 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-d6da09f6-1605-47e7-8d09-a8901aecf19a tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:39.317575 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-d6da09f6-1605-47e7-8d09-a8901aecf19a tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:39.325212 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d6da09f6-1605-47e7-8d09-a8901aecf19a tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:39.325801 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d6da09f6-1605-47e7-8d09-a8901aecf19a tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:39.326285 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d6da09f6-1605-47e7-8d09-a8901aecf19a tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:39.326974 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d6da09f6-1605-47e7-8d09-a8901aecf19a tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:39.327424 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d6da09f6-1605-47e7-8d09-a8901aecf19a tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:39.327923 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d6da09f6-1605-47e7-8d09-a8901aecf19a tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:39.473008 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-d6da09f6-1605-47e7-8d09-a8901aecf19a tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:39.475847 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=100 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:36:39.482395 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-d6da09f6-1605-47e7-8d09-a8901aecf19a tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1667 microversion: 2.1 time: 0.170032 Aug 10 11:36:39.482980 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 235/467] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:39 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1667 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:39.881579 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-d2c0ce9e-3cee-4216-ad9a-c3d89b8fa29c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:39.882196 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-d2c0ce9e-3cee-4216-ad9a-c3d89b8fa29c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:39.889352 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d2c0ce9e-3cee-4216-ad9a-c3d89b8fa29c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:39.889833 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d2c0ce9e-3cee-4216-ad9a-c3d89b8fa29c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:39.890265 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d2c0ce9e-3cee-4216-ad9a-c3d89b8fa29c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:39.891213 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d2c0ce9e-3cee-4216-ad9a-c3d89b8fa29c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:39.891663 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d2c0ce9e-3cee-4216-ad9a-c3d89b8fa29c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:39.892125 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d2c0ce9e-3cee-4216-ad9a-c3d89b8fa29c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:40.020941 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-d2c0ce9e-3cee-4216-ad9a-c3d89b8fa29c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:40.028884 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-d2c0ce9e-3cee-4216-ad9a-c3d89b8fa29c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5" status: 200 len: 1734 microversion: 2.1 time: 0.151144 Aug 10 11:36:40.029443 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 233/468] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:39 2022] GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:40.094159 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-93ca3d07-0ed7-457c-9482-d0798965bbc0 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:40.094695 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-93ca3d07-0ed7-457c-9482-d0798965bbc0 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: ed538b97-8602-402c-8ef9-e25e6d71356a] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:40.101500 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-93ca3d07-0ed7-457c-9482-d0798965bbc0 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:40.101983 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-93ca3d07-0ed7-457c-9482-d0798965bbc0 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:40.102415 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-93ca3d07-0ed7-457c-9482-d0798965bbc0 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:40.103679 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-93ca3d07-0ed7-457c-9482-d0798965bbc0 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:40.104154 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-93ca3d07-0ed7-457c-9482-d0798965bbc0 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:40.104583 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-93ca3d07-0ed7-457c-9482-d0798965bbc0 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:40.235612 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-93ca3d07-0ed7-457c-9482-d0798965bbc0 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:40.243021 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-93ca3d07-0ed7-457c-9482-d0798965bbc0 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a" status: 200 len: 1266 microversion: 2.1 time: 0.152830 Aug 10 11:36:40.243658 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 236/469] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:40 2022] GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:41.050071 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f80a0e94-3f1f-4ea9-82e1-53019f78a0c4 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:41.050883 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-f80a0e94-3f1f-4ea9-82e1-53019f78a0c4 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:41.058240 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f80a0e94-3f1f-4ea9-82e1-53019f78a0c4 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:41.058736 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f80a0e94-3f1f-4ea9-82e1-53019f78a0c4 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:41.059160 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f80a0e94-3f1f-4ea9-82e1-53019f78a0c4 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:41.059862 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f80a0e94-3f1f-4ea9-82e1-53019f78a0c4 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:41.060334 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f80a0e94-3f1f-4ea9-82e1-53019f78a0c4 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:41.060760 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f80a0e94-3f1f-4ea9-82e1-53019f78a0c4 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:41.198483 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-f80a0e94-3f1f-4ea9-82e1-53019f78a0c4 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:41.207671 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-f80a0e94-3f1f-4ea9-82e1-53019f78a0c4 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5" status: 200 len: 1734 microversion: 2.1 time: 0.161258 Aug 10 11:36:41.212970 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 234/470] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:41 2022] GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:41.264312 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-3ec38f4d-a4cd-4e7a-99b6-3f4b538c8c0c tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:41.264928 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-3ec38f4d-a4cd-4e7a-99b6-3f4b538c8c0c tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: ed538b97-8602-402c-8ef9-e25e6d71356a] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:41.272119 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3ec38f4d-a4cd-4e7a-99b6-3f4b538c8c0c tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:41.272608 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3ec38f4d-a4cd-4e7a-99b6-3f4b538c8c0c tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:41.273044 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3ec38f4d-a4cd-4e7a-99b6-3f4b538c8c0c tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:41.273737 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3ec38f4d-a4cd-4e7a-99b6-3f4b538c8c0c tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:41.274191 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3ec38f4d-a4cd-4e7a-99b6-3f4b538c8c0c tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:41.275149 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3ec38f4d-a4cd-4e7a-99b6-3f4b538c8c0c tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:41.416791 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-3ec38f4d-a4cd-4e7a-99b6-3f4b538c8c0c tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:41.439323 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-3ec38f4d-a4cd-4e7a-99b6-3f4b538c8c0c tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a" status: 200 len: 1266 microversion: 2.1 time: 0.177810 Aug 10 11:36:41.440124 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 237/471] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:41 2022] GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:42.230051 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-1af436cc-53f0-4554-81cc-130119edffcf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:42.230658 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-1af436cc-53f0-4554-81cc-130119edffcf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:42.237043 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1af436cc-53f0-4554-81cc-130119edffcf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:42.237524 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1af436cc-53f0-4554-81cc-130119edffcf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:42.237959 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1af436cc-53f0-4554-81cc-130119edffcf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:42.238637 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1af436cc-53f0-4554-81cc-130119edffcf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:42.239090 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1af436cc-53f0-4554-81cc-130119edffcf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:42.239509 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1af436cc-53f0-4554-81cc-130119edffcf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:42.369457 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-1af436cc-53f0-4554-81cc-130119edffcf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:42.377253 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-1af436cc-53f0-4554-81cc-130119edffcf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5" status: 200 len: 1734 microversion: 2.1 time: 0.151944 Aug 10 11:36:42.377816 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 235/472] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:42 2022] GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:42.460193 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-219a7f9f-ddaa-420d-b07d-8db33271d48f tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:42.460785 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-219a7f9f-ddaa-420d-b07d-8db33271d48f tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: ed538b97-8602-402c-8ef9-e25e6d71356a] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:42.467797 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-219a7f9f-ddaa-420d-b07d-8db33271d48f tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:42.468313 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-219a7f9f-ddaa-420d-b07d-8db33271d48f tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:42.468750 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-219a7f9f-ddaa-420d-b07d-8db33271d48f tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:42.469434 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-219a7f9f-ddaa-420d-b07d-8db33271d48f tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:42.469883 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-219a7f9f-ddaa-420d-b07d-8db33271d48f tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:42.470318 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-219a7f9f-ddaa-420d-b07d-8db33271d48f tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:42.606715 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-219a7f9f-ddaa-420d-b07d-8db33271d48f tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:42.614258 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-219a7f9f-ddaa-420d-b07d-8db33271d48f tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a" status: 200 len: 1266 microversion: 2.1 time: 0.158023 Aug 10 11:36:42.614800 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 238/473] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:42 2022] GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:43.400520 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-98958225-a7fe-445c-b52d-4ca00e81ddd0 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:43.401140 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-98958225-a7fe-445c-b52d-4ca00e81ddd0 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:43.406989 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-98958225-a7fe-445c-b52d-4ca00e81ddd0 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:43.407468 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-98958225-a7fe-445c-b52d-4ca00e81ddd0 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:43.407897 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-98958225-a7fe-445c-b52d-4ca00e81ddd0 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:43.408597 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-98958225-a7fe-445c-b52d-4ca00e81ddd0 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:43.409045 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-98958225-a7fe-445c-b52d-4ca00e81ddd0 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:43.409550 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-98958225-a7fe-445c-b52d-4ca00e81ddd0 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:43.538826 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-98958225-a7fe-445c-b52d-4ca00e81ddd0 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:43.547360 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-98958225-a7fe-445c-b52d-4ca00e81ddd0 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5" status: 200 len: 1734 microversion: 2.1 time: 0.151832 Aug 10 11:36:43.547933 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 236/474] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:43 2022] GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:43.634647 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-9ba0e99b-dd62-44ab-b48d-609bf2f2e8ae tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:43.635263 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-9ba0e99b-dd62-44ab-b48d-609bf2f2e8ae tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: ed538b97-8602-402c-8ef9-e25e6d71356a] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:43.642826 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9ba0e99b-dd62-44ab-b48d-609bf2f2e8ae tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:43.643507 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9ba0e99b-dd62-44ab-b48d-609bf2f2e8ae tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:43.644032 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9ba0e99b-dd62-44ab-b48d-609bf2f2e8ae tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:43.644797 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9ba0e99b-dd62-44ab-b48d-609bf2f2e8ae tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:43.645263 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9ba0e99b-dd62-44ab-b48d-609bf2f2e8ae tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:43.645692 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9ba0e99b-dd62-44ab-b48d-609bf2f2e8ae tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:43.782028 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-9ba0e99b-dd62-44ab-b48d-609bf2f2e8ae tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:43.790517 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-9ba0e99b-dd62-44ab-b48d-609bf2f2e8ae tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a" status: 200 len: 1266 microversion: 2.1 time: 0.159162 Aug 10 11:36:43.791102 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 239/475] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:43 2022] GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:44.568529 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f2a8279a-9c6d-4440-8718-436b8df3ae79 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:44.569133 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-f2a8279a-9c6d-4440-8718-436b8df3ae79 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:44.576774 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f2a8279a-9c6d-4440-8718-436b8df3ae79 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:44.577251 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f2a8279a-9c6d-4440-8718-436b8df3ae79 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:44.577681 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f2a8279a-9c6d-4440-8718-436b8df3ae79 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:44.578363 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f2a8279a-9c6d-4440-8718-436b8df3ae79 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:44.578808 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f2a8279a-9c6d-4440-8718-436b8df3ae79 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:44.579229 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f2a8279a-9c6d-4440-8718-436b8df3ae79 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:44.710426 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-f2a8279a-9c6d-4440-8718-436b8df3ae79 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:44.719430 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-f2a8279a-9c6d-4440-8718-436b8df3ae79 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5" status: 200 len: 1734 microversion: 2.1 time: 0.154580 Aug 10 11:36:44.720029 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 237/476] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:44 2022] GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:44.811685 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-61965e28-f23f-4e9a-9bf9-f7bb81a852a8 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:44.812254 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-61965e28-f23f-4e9a-9bf9-f7bb81a852a8 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: ed538b97-8602-402c-8ef9-e25e6d71356a] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:44.818946 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-61965e28-f23f-4e9a-9bf9-f7bb81a852a8 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:44.819428 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-61965e28-f23f-4e9a-9bf9-f7bb81a852a8 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:44.819847 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-61965e28-f23f-4e9a-9bf9-f7bb81a852a8 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:44.820580 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-61965e28-f23f-4e9a-9bf9-f7bb81a852a8 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:44.821585 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-61965e28-f23f-4e9a-9bf9-f7bb81a852a8 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:44.822326 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-61965e28-f23f-4e9a-9bf9-f7bb81a852a8 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:44.886303 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-dc342818-e72e-45f2-844e-479276340ca5 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2040701413", "imageRef": "99bbc441-5102-4a51-a496-cfbffeb3033a", "flavorRef": "452", "networks": [{"uuid": "17695128-e212-4a79-b800-0067981041a8"}]}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:36:44.941125 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.network.neutron [None req-dc342818-e72e-45f2-844e-479276340ca5 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] validate_networks() for [('17695128-e212-4a79-b800-0067981041a8', None, None, None, None, None)] {{(pid=124683) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:36:44.959374 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-61965e28-f23f-4e9a-9bf9-f7bb81a852a8 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:44.967904 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-61965e28-f23f-4e9a-9bf9-f7bb81a852a8 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a" status: 200 len: 1266 microversion: 2.1 time: 0.160134 Aug 10 11:36:44.968648 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 240/477] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:44 2022] GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:36:45.307317 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-dc342818-e72e-45f2-844e-479276340ca5 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Flavor limits 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:36:45.307896 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-dc342818-e72e-45f2-844e-479276340ca5 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Image limits 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:36:45.308434 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-dc342818-e72e-45f2-844e-479276340ca5 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Flavor pref 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:36:45.308855 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-dc342818-e72e-45f2-844e-479276340ca5 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Image pref 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:36:45.309255 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-dc342818-e72e-45f2-844e-479276340ca5 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:36:45.318413 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-dc342818-e72e-45f2-844e-479276340ca5 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:45.319349 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-dc342818-e72e-45f2-844e-479276340ca5 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:45.319499 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-dc342818-e72e-45f2-844e-479276340ca5 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:45.320272 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-dc342818-e72e-45f2-844e-479276340ca5 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:45.320730 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-dc342818-e72e-45f2-844e-479276340ca5 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:45.321860 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-dc342818-e72e-45f2-844e-479276340ca5 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:45.340397 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-dc342818-e72e-45f2-844e-479276340ca5 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Getting quotas for project 8329fbf83b104200a04faaa9c454d708. Resources: {'ram', 'instances', 'cores'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:36:45.344549 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-dc342818-e72e-45f2-844e-479276340ca5 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Getting quotas for user 24d35c64f3a748da9075622e08283aba and project 8329fbf83b104200a04faaa9c454d708. Resources: {'ram', 'instances', 'cores'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:36:45.356287 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-dc342818-e72e-45f2-844e-479276340ca5 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Going to run 1 instances... {{(pid=124683) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:36:45.358708 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-dc342818-e72e-45f2-844e-479276340ca5 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 259e6936-b56d-40bb-8581-afaff6f88644] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99bbc441-5102-4a51-a496-cfbffeb3033a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124683) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:36:45.397339 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-47f60582-5daa-4d9d-952e-48a75b321ebe req-067a88f8-02c6-4e7c-a55e-ee88df8bcd22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed538b97-8602-402c-8ef9-e25e6d71356a", "name": "network-vif-plugged", "status": "completed", "tag": "28ec2bce-b922-4871-b61a-a1d936982071"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:36:45.407362 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-47f60582-5daa-4d9d-952e-48a75b321ebe req-067a88f8-02c6-4e7c-a55e-ee88df8bcd22 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:45.407844 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-47f60582-5daa-4d9d-952e-48a75b321ebe req-067a88f8-02c6-4e7c-a55e-ee88df8bcd22 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:45.408308 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-47f60582-5daa-4d9d-952e-48a75b321ebe req-067a88f8-02c6-4e7c-a55e-ee88df8bcd22 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:45.421085 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-47f60582-5daa-4d9d-952e-48a75b321ebe req-067a88f8-02c6-4e7c-a55e-ee88df8bcd22 service nova] Creating event network-vif-plugged:28ec2bce-b922-4871-b61a-a1d936982071 for instance ed538b97-8602-402c-8ef9-e25e6d71356a on hv-cinder-85272 Aug 10 11:36:45.426137 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-47f60582-5daa-4d9d-952e-48a75b321ebe req-067a88f8-02c6-4e7c-a55e-ee88df8bcd22 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032464 Aug 10 11:36:45.426786 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 241/478] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:36:45.455302 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-dc342818-e72e-45f2-844e-479276340ca5 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.574042 Aug 10 11:36:45.467262 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 238/479] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Aug 10 11:36:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 11:36:45.467844 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-d6219213-687e-4801-9e6e-4442ea75ba29 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:45.468585 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-d6219213-687e-4801-9e6e-4442ea75ba29 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 259e6936-b56d-40bb-8581-afaff6f88644] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:45.523060 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-d6219213-687e-4801-9e6e-4442ea75ba29 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d35c64f3a748da9075622e08283aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8329fbf83b104200a04faaa9c454d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:45.530884 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-d6219213-687e-4801-9e6e-4442ea75ba29 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] 10.222.0.62 "GET /compute/v2.1/servers/259e6936-b56d-40bb-8581-afaff6f88644" status: 200 len: 1219 microversion: 2.1 time: 0.067151 Aug 10 11:36:45.531458 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 242/480] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:45 2022] GET /compute/v2.1/servers/259e6936-b56d-40bb-8581-afaff6f88644 => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:45.742271 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-77a27771-fb91-4ed0-9a5e-74945d0387c1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:45.742878 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-77a27771-fb91-4ed0-9a5e-74945d0387c1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:45.750052 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-77a27771-fb91-4ed0-9a5e-74945d0387c1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:45.750566 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-77a27771-fb91-4ed0-9a5e-74945d0387c1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:45.750996 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-77a27771-fb91-4ed0-9a5e-74945d0387c1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:45.751680 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-77a27771-fb91-4ed0-9a5e-74945d0387c1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:45.752169 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-77a27771-fb91-4ed0-9a5e-74945d0387c1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:45.752593 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-77a27771-fb91-4ed0-9a5e-74945d0387c1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:45.947567 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-77a27771-fb91-4ed0-9a5e-74945d0387c1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:45.955864 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-77a27771-fb91-4ed0-9a5e-74945d0387c1 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5" status: 200 len: 1734 microversion: 2.1 time: 0.218069 Aug 10 11:36:45.963850 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 239/481] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:45 2022] GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5 => generated 1734 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:45.989114 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-0895f098-3863-4f92-be80-52c7352d2529 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:45.989729 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-0895f098-3863-4f92-be80-52c7352d2529 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: ed538b97-8602-402c-8ef9-e25e6d71356a] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:45.992143 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:36:45.998014 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0895f098-3863-4f92-be80-52c7352d2529 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:45.998491 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0895f098-3863-4f92-be80-52c7352d2529 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:45.998928 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0895f098-3863-4f92-be80-52c7352d2529 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:45.999613 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0895f098-3863-4f92-be80-52c7352d2529 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:46.000102 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0895f098-3863-4f92-be80-52c7352d2529 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:46.000529 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0895f098-3863-4f92-be80-52c7352d2529 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:46.133233 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-0895f098-3863-4f92-be80-52c7352d2529 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:46.141699 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-0895f098-3863-4f92-be80-52c7352d2529 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a" status: 200 len: 1266 microversion: 2.1 time: 0.156491 Aug 10 11:36:46.142348 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 243/482] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:45 2022] GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:46.550774 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-68f71eaa-3154-44df-9c34-4d76a0aa30c9 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:46.551391 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-68f71eaa-3154-44df-9c34-4d76a0aa30c9 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 259e6936-b56d-40bb-8581-afaff6f88644] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:46.557676 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-68f71eaa-3154-44df-9c34-4d76a0aa30c9 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:46.558163 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-68f71eaa-3154-44df-9c34-4d76a0aa30c9 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:46.558598 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-68f71eaa-3154-44df-9c34-4d76a0aa30c9 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:46.559395 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-68f71eaa-3154-44df-9c34-4d76a0aa30c9 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:46.559854 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-68f71eaa-3154-44df-9c34-4d76a0aa30c9 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:46.560486 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-68f71eaa-3154-44df-9c34-4d76a0aa30c9 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:46.563123 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:36:46.621711 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-68f71eaa-3154-44df-9c34-4d76a0aa30c9 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d35c64f3a748da9075622e08283aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8329fbf83b104200a04faaa9c454d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:46.629620 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-68f71eaa-3154-44df-9c34-4d76a0aa30c9 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] 10.222.0.62 "GET /compute/v2.1/servers/259e6936-b56d-40bb-8581-afaff6f88644" status: 200 len: 1223 microversion: 2.1 time: 0.082899 Aug 10 11:36:46.632281 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 240/483] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:46 2022] GET /compute/v2.1/servers/259e6936-b56d-40bb-8581-afaff6f88644 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:46.978202 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-0fa21d41-2e06-417c-911d-c111988fb51c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:46.979166 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-0fa21d41-2e06-417c-911d-c111988fb51c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:46.986020 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0fa21d41-2e06-417c-911d-c111988fb51c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:46.986519 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0fa21d41-2e06-417c-911d-c111988fb51c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:46.986949 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0fa21d41-2e06-417c-911d-c111988fb51c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:46.987863 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0fa21d41-2e06-417c-911d-c111988fb51c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:46.988347 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0fa21d41-2e06-417c-911d-c111988fb51c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:46.988805 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0fa21d41-2e06-417c-911d-c111988fb51c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:47.126333 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-0fa21d41-2e06-417c-911d-c111988fb51c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:47.134829 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-0fa21d41-2e06-417c-911d-c111988fb51c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5" status: 200 len: 1734 microversion: 2.1 time: 0.161123 Aug 10 11:36:47.135392 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 244/484] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:46 2022] GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:47.161804 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-15195f0d-1d91-4efb-8564-84520f040d49 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:47.162411 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-15195f0d-1d91-4efb-8564-84520f040d49 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: ed538b97-8602-402c-8ef9-e25e6d71356a] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:47.170283 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-15195f0d-1d91-4efb-8564-84520f040d49 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:47.170770 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-15195f0d-1d91-4efb-8564-84520f040d49 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:47.173883 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-15195f0d-1d91-4efb-8564-84520f040d49 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:47.173883 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-15195f0d-1d91-4efb-8564-84520f040d49 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:47.173883 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-15195f0d-1d91-4efb-8564-84520f040d49 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:47.173883 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-15195f0d-1d91-4efb-8564-84520f040d49 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:47.304720 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-15195f0d-1d91-4efb-8564-84520f040d49 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:47.312706 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-15195f0d-1d91-4efb-8564-84520f040d49 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a" status: 200 len: 1266 microversion: 2.1 time: 0.155019 Aug 10 11:36:47.313272 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 241/485] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:47 2022] GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:47.651853 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-b07d634f-fdba-4557-9ef2-f72bffc502ad tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:47.652490 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-b07d634f-fdba-4557-9ef2-f72bffc502ad tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 259e6936-b56d-40bb-8581-afaff6f88644] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:47.658262 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b07d634f-fdba-4557-9ef2-f72bffc502ad tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:47.658742 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b07d634f-fdba-4557-9ef2-f72bffc502ad tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:47.659181 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b07d634f-fdba-4557-9ef2-f72bffc502ad tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:47.659858 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b07d634f-fdba-4557-9ef2-f72bffc502ad tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:47.660332 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b07d634f-fdba-4557-9ef2-f72bffc502ad tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:47.660751 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b07d634f-fdba-4557-9ef2-f72bffc502ad tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:47.721034 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b07d634f-fdba-4557-9ef2-f72bffc502ad tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d35c64f3a748da9075622e08283aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8329fbf83b104200a04faaa9c454d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:47.728382 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-b07d634f-fdba-4557-9ef2-f72bffc502ad tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] 10.222.0.62 "GET /compute/v2.1/servers/259e6936-b56d-40bb-8581-afaff6f88644" status: 200 len: 1271 microversion: 2.1 time: 0.081567 Aug 10 11:36:47.728948 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 245/486] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:47 2022] GET /compute/v2.1/servers/259e6936-b56d-40bb-8581-afaff6f88644 => generated 1271 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:48.155939 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-e8720044-00dd-4a8f-912c-cb53c8870e3c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:48.156500 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-e8720044-00dd-4a8f-912c-cb53c8870e3c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:48.165049 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e8720044-00dd-4a8f-912c-cb53c8870e3c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:48.165766 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e8720044-00dd-4a8f-912c-cb53c8870e3c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:48.171203 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e8720044-00dd-4a8f-912c-cb53c8870e3c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:48.171203 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e8720044-00dd-4a8f-912c-cb53c8870e3c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:48.171203 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e8720044-00dd-4a8f-912c-cb53c8870e3c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:48.172228 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e8720044-00dd-4a8f-912c-cb53c8870e3c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:48.334399 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-9d58e299-023b-4dd7-a69d-c18e97efd894 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:48.335634 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-9d58e299-023b-4dd7-a69d-c18e97efd894 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: ed538b97-8602-402c-8ef9-e25e6d71356a] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:48.343441 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9d58e299-023b-4dd7-a69d-c18e97efd894 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:48.343952 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9d58e299-023b-4dd7-a69d-c18e97efd894 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:48.344422 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9d58e299-023b-4dd7-a69d-c18e97efd894 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:48.345161 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9d58e299-023b-4dd7-a69d-c18e97efd894 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:48.345629 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9d58e299-023b-4dd7-a69d-c18e97efd894 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:48.346055 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9d58e299-023b-4dd7-a69d-c18e97efd894 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:48.396943 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-e8720044-00dd-4a8f-912c-cb53c8870e3c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:48.405592 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-e8720044-00dd-4a8f-912c-cb53c8870e3c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5" status: 200 len: 1734 microversion: 2.1 time: 0.253675 Aug 10 11:36:48.406367 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 242/487] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:48 2022] GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5 => generated 1734 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:48.488383 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-9d58e299-023b-4dd7-a69d-c18e97efd894 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:48.496088 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-9d58e299-023b-4dd7-a69d-c18e97efd894 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a" status: 200 len: 1454 microversion: 2.1 time: 0.165443 Aug 10 11:36:48.498074 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 246/488] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:48 2022] GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a => generated 1454 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:48.522186 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-da7db39a-7050-4c3d-9364-3b6848aa5669 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:48.522792 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-da7db39a-7050-4c3d-9364-3b6848aa5669 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: ed538b97-8602-402c-8ef9-e25e6d71356a] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:48.525468 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:36:48.530157 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-da7db39a-7050-4c3d-9364-3b6848aa5669 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:48.530641 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-da7db39a-7050-4c3d-9364-3b6848aa5669 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:48.531072 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-da7db39a-7050-4c3d-9364-3b6848aa5669 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:48.539277 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-da7db39a-7050-4c3d-9364-3b6848aa5669 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:48.539277 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-da7db39a-7050-4c3d-9364-3b6848aa5669 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:48.539277 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-da7db39a-7050-4c3d-9364-3b6848aa5669 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:48.731621 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-da7db39a-7050-4c3d-9364-3b6848aa5669 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:48.739266 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-da7db39a-7050-4c3d-9364-3b6848aa5669 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a" status: 200 len: 1454 microversion: 2.1 time: 0.220838 Aug 10 11:36:48.739933 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 243/489] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:48 2022] GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a => generated 1454 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:48.749232 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-c44c4ae9-ce85-40bb-adb5-ab872f7ac471 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:48.750331 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-c44c4ae9-ce85-40bb-adb5-ab872f7ac471 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 259e6936-b56d-40bb-8581-afaff6f88644] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:48.756592 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c44c4ae9-ce85-40bb-adb5-ab872f7ac471 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:48.757069 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c44c4ae9-ce85-40bb-adb5-ab872f7ac471 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:48.757507 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c44c4ae9-ce85-40bb-adb5-ab872f7ac471 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:48.758202 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c44c4ae9-ce85-40bb-adb5-ab872f7ac471 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:48.758722 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c44c4ae9-ce85-40bb-adb5-ab872f7ac471 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:48.759191 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c44c4ae9-ce85-40bb-adb5-ab872f7ac471 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:48.830077 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c44c4ae9-ce85-40bb-adb5-ab872f7ac471 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d35c64f3a748da9075622e08283aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8329fbf83b104200a04faaa9c454d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:48.838308 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-c44c4ae9-ce85-40bb-adb5-ab872f7ac471 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] 10.222.0.62 "GET /compute/v2.1/servers/259e6936-b56d-40bb-8581-afaff6f88644" status: 200 len: 1277 microversion: 2.1 time: 0.092792 Aug 10 11:36:48.851757 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 247/490] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:48 2022] GET /compute/v2.1/servers/259e6936-b56d-40bb-8581-afaff6f88644 => generated 1277 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:49.428006 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-ec981533-6fda-4b88-aa72-d2565b646491 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:49.428633 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-ec981533-6fda-4b88-aa72-d2565b646491 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:49.435824 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ec981533-6fda-4b88-aa72-d2565b646491 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:49.436345 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ec981533-6fda-4b88-aa72-d2565b646491 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:49.436789 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ec981533-6fda-4b88-aa72-d2565b646491 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:49.437487 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ec981533-6fda-4b88-aa72-d2565b646491 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:49.437944 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ec981533-6fda-4b88-aa72-d2565b646491 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:49.438378 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ec981533-6fda-4b88-aa72-d2565b646491 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:49.581345 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-ec981533-6fda-4b88-aa72-d2565b646491 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:49.590377 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-ec981533-6fda-4b88-aa72-d2565b646491 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5" status: 200 len: 1734 microversion: 2.1 time: 0.166143 Aug 10 11:36:49.591296 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 244/491] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:49 2022] GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5 => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:49.858632 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-290f7d67-46c4-49d0-97ce-955fcc6f6ccd tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:49.859235 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-290f7d67-46c4-49d0-97ce-955fcc6f6ccd tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 259e6936-b56d-40bb-8581-afaff6f88644] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:49.865960 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-290f7d67-46c4-49d0-97ce-955fcc6f6ccd tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:49.866448 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-290f7d67-46c4-49d0-97ce-955fcc6f6ccd tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:49.866884 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-290f7d67-46c4-49d0-97ce-955fcc6f6ccd tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:49.867588 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-290f7d67-46c4-49d0-97ce-955fcc6f6ccd tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:49.868652 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-290f7d67-46c4-49d0-97ce-955fcc6f6ccd tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:49.869137 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-290f7d67-46c4-49d0-97ce-955fcc6f6ccd tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:50.162103 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-290f7d67-46c4-49d0-97ce-955fcc6f6ccd tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d35c64f3a748da9075622e08283aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8329fbf83b104200a04faaa9c454d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:50.170943 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-290f7d67-46c4-49d0-97ce-955fcc6f6ccd tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] 10.222.0.62 "GET /compute/v2.1/servers/259e6936-b56d-40bb-8581-afaff6f88644" status: 200 len: 1319 microversion: 2.1 time: 0.316125 Aug 10 11:36:50.184532 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 248/492] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:49 2022] GET /compute/v2.1/servers/259e6936-b56d-40bb-8581-afaff6f88644 => generated 1319 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:50.612804 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-a00cac0a-eb6e-4b37-8f1e-e2708762f1f5 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:50.613410 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-a00cac0a-eb6e-4b37-8f1e-e2708762f1f5 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:50.620833 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a00cac0a-eb6e-4b37-8f1e-e2708762f1f5 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:50.621308 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a00cac0a-eb6e-4b37-8f1e-e2708762f1f5 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:50.621774 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a00cac0a-eb6e-4b37-8f1e-e2708762f1f5 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:50.622461 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a00cac0a-eb6e-4b37-8f1e-e2708762f1f5 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:50.622911 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a00cac0a-eb6e-4b37-8f1e-e2708762f1f5 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:50.623329 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a00cac0a-eb6e-4b37-8f1e-e2708762f1f5 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:50.660446 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-a8041afd-bb4d-4470-a150-ae62fd5f1a7b req-3c053c29-c6bb-4d79-b353-dfc99d784c07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "259e6936-b56d-40bb-8581-afaff6f88644", "tag": "bd05ca4a-2492-4e02-9e80-88caa8663368"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:36:50.678476 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-a8041afd-bb4d-4470-a150-ae62fd5f1a7b req-3c053c29-c6bb-4d79-b353-dfc99d784c07 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:50.679792 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-a8041afd-bb4d-4470-a150-ae62fd5f1a7b req-3c053c29-c6bb-4d79-b353-dfc99d784c07 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:50.682380 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-a8041afd-bb4d-4470-a150-ae62fd5f1a7b req-3c053c29-c6bb-4d79-b353-dfc99d784c07 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:50.704344 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-a8041afd-bb4d-4470-a150-ae62fd5f1a7b req-3c053c29-c6bb-4d79-b353-dfc99d784c07 service nova] Creating event network-changed:bd05ca4a-2492-4e02-9e80-88caa8663368 for instance 259e6936-b56d-40bb-8581-afaff6f88644 on hv-cinder-85272 Aug 10 11:36:50.714200 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-a8041afd-bb4d-4470-a150-ae62fd5f1a7b req-3c053c29-c6bb-4d79-b353-dfc99d784c07 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059894 Aug 10 11:36:50.715620 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 249/493] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:36:50.809293 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-a00cac0a-eb6e-4b37-8f1e-e2708762f1f5 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:50.817392 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-a00cac0a-eb6e-4b37-8f1e-e2708762f1f5 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5" status: 200 len: 1734 microversion: 2.1 time: 0.208548 Aug 10 11:36:50.821427 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 245/494] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:50 2022] GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5 => generated 1734 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:51.192169 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-5c50d41b-f324-4444-8398-8c741928a7bc tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:51.192947 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-5c50d41b-f324-4444-8398-8c741928a7bc tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 259e6936-b56d-40bb-8581-afaff6f88644] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:51.199546 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5c50d41b-f324-4444-8398-8c741928a7bc tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:51.200146 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5c50d41b-f324-4444-8398-8c741928a7bc tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:51.200652 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5c50d41b-f324-4444-8398-8c741928a7bc tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:51.201435 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5c50d41b-f324-4444-8398-8c741928a7bc tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:51.201951 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5c50d41b-f324-4444-8398-8c741928a7bc tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:51.202440 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5c50d41b-f324-4444-8398-8c741928a7bc tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:51.312048 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-99609286-2124-4a30-858d-b0dd44afb78b req-a251b427-6a03-4f87-92a4-9728667b686b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed538b97-8602-402c-8ef9-e25e6d71356a", "tag": "28ec2bce-b922-4871-b61a-a1d936982071"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:36:51.323641 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-99609286-2124-4a30-858d-b0dd44afb78b req-a251b427-6a03-4f87-92a4-9728667b686b service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:51.324240 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-99609286-2124-4a30-858d-b0dd44afb78b req-a251b427-6a03-4f87-92a4-9728667b686b service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:51.324760 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-99609286-2124-4a30-858d-b0dd44afb78b req-a251b427-6a03-4f87-92a4-9728667b686b service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:51.336818 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-99609286-2124-4a30-858d-b0dd44afb78b req-a251b427-6a03-4f87-92a4-9728667b686b service nova] Creating event network-changed:28ec2bce-b922-4871-b61a-a1d936982071 for instance ed538b97-8602-402c-8ef9-e25e6d71356a on hv-cinder-85272 Aug 10 11:36:51.342416 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-99609286-2124-4a30-858d-b0dd44afb78b req-a251b427-6a03-4f87-92a4-9728667b686b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034248 Aug 10 11:36:51.343166 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 246/495] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:36:51.389160 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-5c50d41b-f324-4444-8398-8c741928a7bc tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d35c64f3a748da9075622e08283aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8329fbf83b104200a04faaa9c454d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:51.398898 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-5c50d41b-f324-4444-8398-8c741928a7bc tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] 10.222.0.62 "GET /compute/v2.1/servers/259e6936-b56d-40bb-8581-afaff6f88644" status: 200 len: 1319 microversion: 2.1 time: 0.211403 Aug 10 11:36:51.400035 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 250/496] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:51 2022] GET /compute/v2.1/servers/259e6936-b56d-40bb-8581-afaff6f88644 => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:51.840596 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-19fe48b5-7bee-44ca-97cb-183191916aed tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:51.841347 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-19fe48b5-7bee-44ca-97cb-183191916aed tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:51.847931 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-19fe48b5-7bee-44ca-97cb-183191916aed tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:51.848442 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-19fe48b5-7bee-44ca-97cb-183191916aed tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:51.848889 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-19fe48b5-7bee-44ca-97cb-183191916aed tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:51.849549 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-19fe48b5-7bee-44ca-97cb-183191916aed tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:51.849995 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-19fe48b5-7bee-44ca-97cb-183191916aed tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:51.850409 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-19fe48b5-7bee-44ca-97cb-183191916aed tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:51.984491 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-19fe48b5-7bee-44ca-97cb-183191916aed tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:51.993578 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-19fe48b5-7bee-44ca-97cb-183191916aed tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5" status: 200 len: 1714 microversion: 2.1 time: 0.156735 Aug 10 11:36:51.999655 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 247/497] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:51 2022] GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5 => generated 1714 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:52.149295 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-491413e9-ba74-4ff2-94a2-504c3604afaf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:52.152077 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-491413e9-ba74-4ff2-94a2-504c3604afaf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:52.159710 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-491413e9-ba74-4ff2-94a2-504c3604afaf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:52.160573 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-491413e9-ba74-4ff2-94a2-504c3604afaf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:52.161206 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-491413e9-ba74-4ff2-94a2-504c3604afaf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:52.162156 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-491413e9-ba74-4ff2-94a2-504c3604afaf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:52.162792 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-491413e9-ba74-4ff2-94a2-504c3604afaf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:52.163463 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-491413e9-ba74-4ff2-94a2-504c3604afaf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:52.270720 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.wsgi [None req-491413e9-ba74-4ff2-94a2-504c3604afaf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] HTTP exception thrown: Cannot 'detach_volume' instance f70dab9f-931f-4e70-bb09-0a053d3220a5 while it is in vm_state rescued Aug 10 11:36:52.272511 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-491413e9-ba74-4ff2-94a2-504c3604afaf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Request method failure captured: Aug 10 11:36:52.272511 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: request: DELETE /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5/os-volume_attachments/5b892eb7-3331-4840-a16d-f1f7d17913eb HTTP/1.1 Aug 10 11:36:52.272511 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Accept: application/json Aug 10 11:36:52.272511 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Aug 10 11:36:52.272511 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Connection: close Aug 10 11:36:52.272511 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Content-Length: 0 Aug 10 11:36:52.272511 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Content-Type: application/json Aug 10 11:36:52.272511 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Host: 10.222.0.62 Aug 10 11:36:52.272511 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Aug 10 11:36:52.272511 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.11 Aug 10 11:36:52.272511 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABi85diKAHwXRzd2il03BjBn4GtPc8kISXNr_WlbPfAO6ScxlA2xKRFTXp6lv4Mx70H4OHfMxyACT9qtANdjRUlG0IXG7zsJ6Yh5tFE6PbxXVb6Pm5mIqh7eSEB9wtnuv9htvQ1QMN0TYW9yui41zYItyS58rcQtQxa6iH9KCT_lRB8CpA Aug 10 11:36:52.272511 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Aug 10 11:36:52.272511 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Aug 10 11:36:52.272511 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Aug 10 11:36:52.272511 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Aug 10 11:36:52.272511 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Aug 10 11:36:52.272511 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Aug 10 11:36:52.272511 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Id: a66fd06041084a16b8d5c5b9a9dbea52 Aug 10 11:36:52.272511 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-956924328 Aug 10 11:36:52.272511 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Role: member,reader Aug 10 11:36:52.272511 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Aug 10 11:36:52.275708 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/a66fd06041084a16b8d5c5b9a9dbea52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_a66fd06041084a16b8d5c5b9a9dbea52", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a66fd06041084a16b8d5c5b9a9dbea52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a66fd06041084a16b8d5c5b9a9dbea52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:36:52.275708 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-ServerRescueNegativeTestJSON-956924328 Aug 10 11:36:52.275708 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant-Id: a66fd06041084a16b8d5c5b9a9dbea52 Aug 10 11:36:52.275708 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-956924328 Aug 10 11:36:52.275708 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User: tempest-ServerRescueNegativeTestJSON-956924328-project Aug 10 11:36:52.275708 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Aug 10 11:36:52.275708 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Aug 10 11:36:52.275708 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Id: 81be34fdd1d741719b317b4fed21636d Aug 10 11:36:52.275708 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-ServerRescueNegativeTestJSON-956924328-project Aug 10 11:36:52.275708 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: method: > Aug 10 11:36:52.275708 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: exception: Cannot 'detach_volume' instance f70dab9f-931f-4e70-bb09-0a053d3220a5 while it is in vm_state rescued Aug 10 11:36:52.276781 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: action_args: {'server_id': 'f70dab9f-931f-4e70-bb09-0a053d3220a5', 'id': '5b892eb7-3331-4840-a16d-f1f7d17913eb'} Aug 10 11:36:52.276781 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:36:52.276781 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:36:52.276781 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 10 11:36:52.276781 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 10 11:36:52.276781 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 11:36:52.276781 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 11:36:52.276781 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 10 11:36:52.276781 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 10 11:36:52.276781 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f70dab9f-931f-4e70-bb09-0a053d3220a5 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 10 11:36:52.276781 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:36:52.276781 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:36:52.276781 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:36:52.276781 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:36:52.276781 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:36:52.276781 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:36:52.276781 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:36:52.276781 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:36:52.276781 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:36:52.276781 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:36:52.278317 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 10 11:36:52.278317 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 10 11:36:52.278317 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 10 11:36:52.278317 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 10 11:36:52.278317 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance f70dab9f-931f-4e70-bb09-0a053d3220a5 while it is in vm_state rescued Aug 10 11:36:52.278317 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:36:52.278317 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:36:52.278317 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:36:52.278317 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:36:52.278317 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:36:52.278317 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:36:52.278317 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:36:52.278317 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:36:52.278317 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance f70dab9f-931f-4e70-bb09-0a053d3220a5 while it is in vm_state rescued Aug 10 11:36:52.278317 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:36:52.278317 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-491413e9-ba74-4ff2-94a2-504c3604afaf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Returning 409 to user: Cannot 'detach_volume' instance f70dab9f-931f-4e70-bb09-0a053d3220a5 while it is in vm_state rescued {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:36:52.279517 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-491413e9-ba74-4ff2-94a2-504c3604afaf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "DELETE /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5/os-volume_attachments/5b892eb7-3331-4840-a16d-f1f7d17913eb" status: 409 len: 152 microversion: 2.1 time: 0.130824 Aug 10 11:36:52.280114 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 251/498] 10.222.0.62 () {58 vars in 1416 bytes} [Wed Aug 10 11:36:52 2022] DELETE /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5/os-volume_attachments/5b892eb7-3331-4840-a16d-f1f7d17913eb => generated 152 bytes in 136 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 10 11:36:52.288927 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f63ea15e-ee4c-4887-9e68-126aaaf556bf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:36:52.289464 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-f63ea15e-ee4c-4887-9e68-126aaaf556bf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:52.302425 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f63ea15e-ee4c-4887-9e68-126aaaf556bf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:52.303279 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f63ea15e-ee4c-4887-9e68-126aaaf556bf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:52.303497 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f63ea15e-ee4c-4887-9e68-126aaaf556bf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:52.304234 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f63ea15e-ee4c-4887-9e68-126aaaf556bf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:52.304689 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f63ea15e-ee4c-4887-9e68-126aaaf556bf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:52.306430 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f63ea15e-ee4c-4887-9e68-126aaaf556bf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:52.421005 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-e3c54d12-1e73-47fe-8b25-97f1861209ea tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:52.422011 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-e3c54d12-1e73-47fe-8b25-97f1861209ea tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 259e6936-b56d-40bb-8581-afaff6f88644] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:52.429692 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e3c54d12-1e73-47fe-8b25-97f1861209ea tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:52.430960 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e3c54d12-1e73-47fe-8b25-97f1861209ea tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:52.431402 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e3c54d12-1e73-47fe-8b25-97f1861209ea tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:52.432290 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e3c54d12-1e73-47fe-8b25-97f1861209ea tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:52.432753 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e3c54d12-1e73-47fe-8b25-97f1861209ea tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:52.433663 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e3c54d12-1e73-47fe-8b25-97f1861209ea tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:52.520620 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-f63ea15e-ee4c-4887-9e68-126aaaf556bf tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "POST /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5/action" status: 202 len: 0 microversion: 2.1 time: 0.235405 Aug 10 11:36:52.521338 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 248/499] 10.222.0.62 () {60 vars in 1278 bytes} [Wed Aug 10 11:36:52 2022] POST /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:36:52.537227 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-d006d191-391f-4207-a3f8-2774ed330b3d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:52.538042 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-d006d191-391f-4207-a3f8-2774ed330b3d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:52.544656 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d006d191-391f-4207-a3f8-2774ed330b3d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:52.545443 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d006d191-391f-4207-a3f8-2774ed330b3d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:52.545886 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d006d191-391f-4207-a3f8-2774ed330b3d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:52.546586 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d006d191-391f-4207-a3f8-2774ed330b3d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:52.547047 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d006d191-391f-4207-a3f8-2774ed330b3d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:52.547577 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d006d191-391f-4207-a3f8-2774ed330b3d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:52.627657 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-e3c54d12-1e73-47fe-8b25-97f1861209ea tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d35c64f3a748da9075622e08283aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8329fbf83b104200a04faaa9c454d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:52.635497 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-e3c54d12-1e73-47fe-8b25-97f1861209ea tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] 10.222.0.62 "GET /compute/v2.1/servers/259e6936-b56d-40bb-8581-afaff6f88644" status: 200 len: 1319 microversion: 2.1 time: 0.218416 Aug 10 11:36:52.636759 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 252/500] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:52 2022] GET /compute/v2.1/servers/259e6936-b56d-40bb-8581-afaff6f88644 => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:52.682160 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-d006d191-391f-4207-a3f8-2774ed330b3d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:52.690156 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-d006d191-391f-4207-a3f8-2774ed330b3d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5" status: 200 len: 1722 microversion: 2.1 time: 0.157223 Aug 10 11:36:52.690743 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 249/501] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:52 2022] GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:53.657027 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-0a802d5d-2a49-4b18-b0e0-ca44b1f29078 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:53.657641 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-0a802d5d-2a49-4b18-b0e0-ca44b1f29078 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 259e6936-b56d-40bb-8581-afaff6f88644] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:53.664071 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0a802d5d-2a49-4b18-b0e0-ca44b1f29078 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:53.665214 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0a802d5d-2a49-4b18-b0e0-ca44b1f29078 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:53.665716 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0a802d5d-2a49-4b18-b0e0-ca44b1f29078 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:53.666399 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0a802d5d-2a49-4b18-b0e0-ca44b1f29078 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:53.666857 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0a802d5d-2a49-4b18-b0e0-ca44b1f29078 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:53.667283 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0a802d5d-2a49-4b18-b0e0-ca44b1f29078 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:53.710804 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-db038b73-5074-496e-9a61-dbfebf51705d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:53.711452 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-db038b73-5074-496e-9a61-dbfebf51705d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:53.717839 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-db038b73-5074-496e-9a61-dbfebf51705d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:53.718320 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-db038b73-5074-496e-9a61-dbfebf51705d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:53.718750 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-db038b73-5074-496e-9a61-dbfebf51705d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:53.719435 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-db038b73-5074-496e-9a61-dbfebf51705d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:53.719879 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-db038b73-5074-496e-9a61-dbfebf51705d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:53.720329 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-db038b73-5074-496e-9a61-dbfebf51705d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:53.858596 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-db038b73-5074-496e-9a61-dbfebf51705d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:53.866473 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-db038b73-5074-496e-9a61-dbfebf51705d tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5" status: 200 len: 1722 microversion: 2.1 time: 0.159506 Aug 10 11:36:53.867043 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 250/502] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:53 2022] GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:36:53.902464 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-0a802d5d-2a49-4b18-b0e0-ca44b1f29078 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d35c64f3a748da9075622e08283aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8329fbf83b104200a04faaa9c454d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:53.909928 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-0a802d5d-2a49-4b18-b0e0-ca44b1f29078 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] 10.222.0.62 "GET /compute/v2.1/servers/259e6936-b56d-40bb-8581-afaff6f88644" status: 200 len: 1319 microversion: 2.1 time: 0.256667 Aug 10 11:36:53.910459 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 253/503] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:53 2022] GET /compute/v2.1/servers/259e6936-b56d-40bb-8581-afaff6f88644 => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:54.888384 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-445235a8-005c-4278-b6b9-f7a6004749f6 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:54.888988 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-445235a8-005c-4278-b6b9-f7a6004749f6 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:54.895702 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-445235a8-005c-4278-b6b9-f7a6004749f6 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:54.900832 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-445235a8-005c-4278-b6b9-f7a6004749f6 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:54.900832 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-445235a8-005c-4278-b6b9-f7a6004749f6 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:54.900832 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-445235a8-005c-4278-b6b9-f7a6004749f6 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:54.900832 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-445235a8-005c-4278-b6b9-f7a6004749f6 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:54.901336 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-445235a8-005c-4278-b6b9-f7a6004749f6 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:54.930606 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-da7ccf60-e321-4f4a-913f-e91939d3c740 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:54.931418 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-da7ccf60-e321-4f4a-913f-e91939d3c740 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 259e6936-b56d-40bb-8581-afaff6f88644] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:54.938007 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-da7ccf60-e321-4f4a-913f-e91939d3c740 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:54.938496 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-da7ccf60-e321-4f4a-913f-e91939d3c740 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:54.938937 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-da7ccf60-e321-4f4a-913f-e91939d3c740 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:54.939636 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-da7ccf60-e321-4f4a-913f-e91939d3c740 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:54.940120 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-da7ccf60-e321-4f4a-913f-e91939d3c740 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:54.940551 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-da7ccf60-e321-4f4a-913f-e91939d3c740 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:55.031019 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-445235a8-005c-4278-b6b9-f7a6004749f6 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:55.039013 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-445235a8-005c-4278-b6b9-f7a6004749f6 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5" status: 200 len: 1722 microversion: 2.1 time: 0.154406 Aug 10 11:36:55.040287 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 251/504] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:54 2022] GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:55.073685 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-da7ccf60-e321-4f4a-913f-e91939d3c740 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d35c64f3a748da9075622e08283aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8329fbf83b104200a04faaa9c454d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:55.075997 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=100 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:36:55.081797 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-da7ccf60-e321-4f4a-913f-e91939d3c740 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] 10.222.0.62 "GET /compute/v2.1/servers/259e6936-b56d-40bb-8581-afaff6f88644" status: 200 len: 1319 microversion: 2.1 time: 0.154995 Aug 10 11:36:55.082352 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 254/505] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:54 2022] GET /compute/v2.1/servers/259e6936-b56d-40bb-8581-afaff6f88644 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:36:56.061746 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-fda9497d-bf0b-4468-98f0-929a8647f076 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:56.062391 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-fda9497d-bf0b-4468-98f0-929a8647f076 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:56.064357 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=2 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:36:56.065043 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=6 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:36:56.070301 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fda9497d-bf0b-4468-98f0-929a8647f076 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:56.071022 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fda9497d-bf0b-4468-98f0-929a8647f076 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:56.071504 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fda9497d-bf0b-4468-98f0-929a8647f076 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:56.072238 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fda9497d-bf0b-4468-98f0-929a8647f076 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:56.072750 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fda9497d-bf0b-4468-98f0-929a8647f076 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:56.073277 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fda9497d-bf0b-4468-98f0-929a8647f076 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:56.105717 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-6e9f1843-e216-445e-9d63-41ca7e8c39a1 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:56.107923 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-6e9f1843-e216-445e-9d63-41ca7e8c39a1 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 259e6936-b56d-40bb-8581-afaff6f88644] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:56.110076 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=2 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:36:56.116130 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6e9f1843-e216-445e-9d63-41ca7e8c39a1 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:56.118335 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6e9f1843-e216-445e-9d63-41ca7e8c39a1 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:56.118335 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6e9f1843-e216-445e-9d63-41ca7e8c39a1 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:56.119625 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6e9f1843-e216-445e-9d63-41ca7e8c39a1 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:56.120487 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6e9f1843-e216-445e-9d63-41ca7e8c39a1 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:56.121053 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6e9f1843-e216-445e-9d63-41ca7e8c39a1 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:56.213816 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-fda9497d-bf0b-4468-98f0-929a8647f076 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:56.222352 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-fda9497d-bf0b-4468-98f0-929a8647f076 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5" status: 200 len: 1722 microversion: 2.1 time: 0.164542 Aug 10 11:36:56.223140 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 252/506] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:56 2022] GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:56.262260 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-6e9f1843-e216-445e-9d63-41ca7e8c39a1 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d35c64f3a748da9075622e08283aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8329fbf83b104200a04faaa9c454d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:56.270645 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-6e9f1843-e216-445e-9d63-41ca7e8c39a1 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] 10.222.0.62 "GET /compute/v2.1/servers/259e6936-b56d-40bb-8581-afaff6f88644" status: 200 len: 1319 microversion: 2.1 time: 0.169628 Aug 10 11:36:56.271202 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 255/507] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:56 2022] GET /compute/v2.1/servers/259e6936-b56d-40bb-8581-afaff6f88644 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:36:57.244232 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-1c975af4-86c1-4e28-a5db-098100bf4db4 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:57.244853 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-1c975af4-86c1-4e28-a5db-098100bf4db4 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:57.251296 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1c975af4-86c1-4e28-a5db-098100bf4db4 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:57.251783 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1c975af4-86c1-4e28-a5db-098100bf4db4 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:57.252258 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1c975af4-86c1-4e28-a5db-098100bf4db4 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:57.252955 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1c975af4-86c1-4e28-a5db-098100bf4db4 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:57.253417 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1c975af4-86c1-4e28-a5db-098100bf4db4 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:57.253844 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1c975af4-86c1-4e28-a5db-098100bf4db4 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:57.290812 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-d35ee1ec-786e-43b5-ac59-8f57d06c4548 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:57.291422 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-d35ee1ec-786e-43b5-ac59-8f57d06c4548 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 259e6936-b56d-40bb-8581-afaff6f88644] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:57.298377 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d35ee1ec-786e-43b5-ac59-8f57d06c4548 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:57.298858 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d35ee1ec-786e-43b5-ac59-8f57d06c4548 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:57.299301 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d35ee1ec-786e-43b5-ac59-8f57d06c4548 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:57.300064 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d35ee1ec-786e-43b5-ac59-8f57d06c4548 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:57.300472 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d35ee1ec-786e-43b5-ac59-8f57d06c4548 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:57.300895 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d35ee1ec-786e-43b5-ac59-8f57d06c4548 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:57.391269 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-1c975af4-86c1-4e28-a5db-098100bf4db4 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:57.406327 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-1c975af4-86c1-4e28-a5db-098100bf4db4 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5" status: 200 len: 1728 microversion: 2.1 time: 0.166596 Aug 10 11:36:57.406915 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 253/508] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:57 2022] GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5 => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:57.427558 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-9951e6cd-e8d8-43bd-b572-d25fef0797e0 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:57.428238 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-9951e6cd-e8d8-43bd-b572-d25fef0797e0 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:57.435182 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9951e6cd-e8d8-43bd-b572-d25fef0797e0 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:57.435675 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9951e6cd-e8d8-43bd-b572-d25fef0797e0 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:57.436181 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9951e6cd-e8d8-43bd-b572-d25fef0797e0 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:57.436944 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9951e6cd-e8d8-43bd-b572-d25fef0797e0 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:57.437354 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9951e6cd-e8d8-43bd-b572-d25fef0797e0 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:57.437785 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9951e6cd-e8d8-43bd-b572-d25fef0797e0 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:57.438468 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-d35ee1ec-786e-43b5-ac59-8f57d06c4548 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d35c64f3a748da9075622e08283aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8329fbf83b104200a04faaa9c454d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:57.446011 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-d35ee1ec-786e-43b5-ac59-8f57d06c4548 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] 10.222.0.62 "GET /compute/v2.1/servers/259e6936-b56d-40bb-8581-afaff6f88644" status: 200 len: 1319 microversion: 2.1 time: 0.159090 Aug 10 11:36:57.446590 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 256/509] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:57 2022] GET /compute/v2.1/servers/259e6936-b56d-40bb-8581-afaff6f88644 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:36:57.514326 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-9951e6cd-e8d8-43bd-b572-d25fef0797e0 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090537 Aug 10 11:36:57.515054 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 254/510] 10.222.0.62 () {58 vars in 1275 bytes} [Wed Aug 10 11:36:57 2022] GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:36:58.065587 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-5615fc2a-0d50-40f9-974c-e394f56aa951 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:58.066182 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-5615fc2a-0d50-40f9-974c-e394f56aa951 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:58.072833 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5615fc2a-0d50-40f9-974c-e394f56aa951 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:58.073306 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5615fc2a-0d50-40f9-974c-e394f56aa951 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:58.073739 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5615fc2a-0d50-40f9-974c-e394f56aa951 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:58.074429 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5615fc2a-0d50-40f9-974c-e394f56aa951 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:58.074877 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5615fc2a-0d50-40f9-974c-e394f56aa951 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:58.075300 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5615fc2a-0d50-40f9-974c-e394f56aa951 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:58.104287 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-5615fc2a-0d50-40f9-974c-e394f56aa951 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05/os-volume_attachments/4c503898-e6f2-4f33-89ad-5fff81617329" status: 200 len: 194 microversion: 2.20 time: 0.042421 Aug 10 11:36:58.104856 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 257/511] 10.222.0.62 () {60 vars in 1454 bytes} [Wed Aug 10 11:36:58 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05/os-volume_attachments/4c503898-e6f2-4f33-89ad-5fff81617329 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:36:58.177794 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-43c6f100-bb9b-42d2-bef8-b9dac73e57f7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:58.178615 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-43c6f100-bb9b-42d2-bef8-b9dac73e57f7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:58.190286 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-43c6f100-bb9b-42d2-bef8-b9dac73e57f7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:58.193481 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-43c6f100-bb9b-42d2-bef8-b9dac73e57f7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:58.193481 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-43c6f100-bb9b-42d2-bef8-b9dac73e57f7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:58.193481 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-43c6f100-bb9b-42d2-bef8-b9dac73e57f7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:58.193481 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-43c6f100-bb9b-42d2-bef8-b9dac73e57f7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:58.193860 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-43c6f100-bb9b-42d2-bef8-b9dac73e57f7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:58.281206 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.objects.instance [None req-43c6f100-bb9b-42d2-bef8-b9dac73e57f7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lazy-loading 'services' on Instance uuid 9e6ed242-956f-4b14-8520-18920447bf05 {{(pid=124683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:36:58.467665 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-d3e29db9-5788-42b6-8358-b21140e19dab tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:58.468646 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-d3e29db9-5788-42b6-8358-b21140e19dab tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 259e6936-b56d-40bb-8581-afaff6f88644] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:58.475940 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d3e29db9-5788-42b6-8358-b21140e19dab tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:58.476821 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d3e29db9-5788-42b6-8358-b21140e19dab tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:58.477285 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d3e29db9-5788-42b6-8358-b21140e19dab tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:58.478155 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d3e29db9-5788-42b6-8358-b21140e19dab tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:58.478619 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d3e29db9-5788-42b6-8358-b21140e19dab tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:58.479051 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d3e29db9-5788-42b6-8358-b21140e19dab tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:58.491699 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-43c6f100-bb9b-42d2-bef8-b9dac73e57f7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "DELETE /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05/os-volume_attachments/4c503898-e6f2-4f33-89ad-5fff81617329" status: 202 len: 0 microversion: 2.20 time: 0.317907 Aug 10 11:36:58.492875 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 255/512] 10.222.0.62 () {60 vars in 1457 bytes} [Wed Aug 10 11:36:58 2022] DELETE /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05/os-volume_attachments/4c503898-e6f2-4f33-89ad-5fff81617329 => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:36:58.498024 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-0b164dda-346c-4292-a7a7-44b13b84e89a req-2e2b32a6-8a62-495f-8716-f868ca73a437 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f70dab9f-931f-4e70-bb09-0a053d3220a5", "tag": "53b710b6-9aea-4621-bdee-7da9637f2bfd"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:36:58.512510 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-0b164dda-346c-4292-a7a7-44b13b84e89a req-2e2b32a6-8a62-495f-8716-f868ca73a437 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:58.512991 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-0b164dda-346c-4292-a7a7-44b13b84e89a req-2e2b32a6-8a62-495f-8716-f868ca73a437 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:58.514217 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-0b164dda-346c-4292-a7a7-44b13b84e89a req-2e2b32a6-8a62-495f-8716-f868ca73a437 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:58.518099 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:36:58.525806 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-0b164dda-346c-4292-a7a7-44b13b84e89a req-2e2b32a6-8a62-495f-8716-f868ca73a437 service nova] Creating event network-changed:53b710b6-9aea-4621-bdee-7da9637f2bfd for instance f70dab9f-931f-4e70-bb09-0a053d3220a5 on hv-cinder-85272 Aug 10 11:36:58.531171 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-0b164dda-346c-4292-a7a7-44b13b84e89a req-2e2b32a6-8a62-495f-8716-f868ca73a437 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036809 Aug 10 11:36:58.532023 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 256/513] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:36:58.547215 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-68deae37-5f04-45fa-b973-10c1e53659fa tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:58.554027 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-68deae37-5f04-45fa-b973-10c1e53659fa tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:58.562213 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-68deae37-5f04-45fa-b973-10c1e53659fa tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:58.562731 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-68deae37-5f04-45fa-b973-10c1e53659fa tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:58.563343 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-68deae37-5f04-45fa-b973-10c1e53659fa tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:58.564109 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-68deae37-5f04-45fa-b973-10c1e53659fa tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:58.564548 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-68deae37-5f04-45fa-b973-10c1e53659fa tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:58.575590 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-68deae37-5f04-45fa-b973-10c1e53659fa tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:58.598515 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-68deae37-5f04-45fa-b973-10c1e53659fa tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062283 Aug 10 11:36:58.599847 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 257/514] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 10 11:36:58 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:36:58.718639 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-d3e29db9-5788-42b6-8358-b21140e19dab tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d35c64f3a748da9075622e08283aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8329fbf83b104200a04faaa9c454d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:58.728673 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-d3e29db9-5788-42b6-8358-b21140e19dab tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] 10.222.0.62 "GET /compute/v2.1/servers/259e6936-b56d-40bb-8581-afaff6f88644" status: 200 len: 1319 microversion: 2.1 time: 0.264895 Aug 10 11:36:58.729934 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 258/515] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:58 2022] GET /compute/v2.1/servers/259e6936-b56d-40bb-8581-afaff6f88644 => generated 1319 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:36:59.472443 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-24c67078-f0c8-4b5d-9419-74c3b826eb27 req-8789631d-9354-44fc-bc43-387736fb9800 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "259e6936-b56d-40bb-8581-afaff6f88644", "name": "network-vif-plugged", "status": "completed", "tag": "bd05ca4a-2492-4e02-9e80-88caa8663368"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:36:59.485354 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-24c67078-f0c8-4b5d-9419-74c3b826eb27 req-8789631d-9354-44fc-bc43-387736fb9800 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:59.486041 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-24c67078-f0c8-4b5d-9419-74c3b826eb27 req-8789631d-9354-44fc-bc43-387736fb9800 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:59.486476 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-24c67078-f0c8-4b5d-9419-74c3b826eb27 req-8789631d-9354-44fc-bc43-387736fb9800 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:59.500495 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-24c67078-f0c8-4b5d-9419-74c3b826eb27 req-8789631d-9354-44fc-bc43-387736fb9800 service nova] Creating event network-vif-plugged:bd05ca4a-2492-4e02-9e80-88caa8663368 for instance 259e6936-b56d-40bb-8581-afaff6f88644 on hv-cinder-85272 Aug 10 11:36:59.504121 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-24c67078-f0c8-4b5d-9419-74c3b826eb27 req-8789631d-9354-44fc-bc43-387736fb9800 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037656 Aug 10 11:36:59.505038 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 258/516] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:36:59.612928 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-7e34716b-9c0f-4bcb-89b8-6114ccc199fe tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:59.615052 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-7e34716b-9c0f-4bcb-89b8-6114ccc199fe tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:59.621931 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7e34716b-9c0f-4bcb-89b8-6114ccc199fe tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:59.622420 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7e34716b-9c0f-4bcb-89b8-6114ccc199fe tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:59.622843 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7e34716b-9c0f-4bcb-89b8-6114ccc199fe tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:59.629369 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7e34716b-9c0f-4bcb-89b8-6114ccc199fe tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:59.629369 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7e34716b-9c0f-4bcb-89b8-6114ccc199fe tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:59.629369 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7e34716b-9c0f-4bcb-89b8-6114ccc199fe tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:59.659764 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-7e34716b-9c0f-4bcb-89b8-6114ccc199fe tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050906 Aug 10 11:36:59.660360 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 259/517] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 10 11:36:59 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:36:59.750538 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-7831f027-4808-4e44-86e8-51fad5c92389 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:59.751240 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-7831f027-4808-4e44-86e8-51fad5c92389 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 259e6936-b56d-40bb-8581-afaff6f88644] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:36:59.757638 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7831f027-4808-4e44-86e8-51fad5c92389 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:59.758120 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7831f027-4808-4e44-86e8-51fad5c92389 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:59.759537 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7831f027-4808-4e44-86e8-51fad5c92389 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:59.759537 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7831f027-4808-4e44-86e8-51fad5c92389 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:36:59.759861 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7831f027-4808-4e44-86e8-51fad5c92389 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:36:59.760198 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7831f027-4808-4e44-86e8-51fad5c92389 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:36:59.893780 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-7831f027-4808-4e44-86e8-51fad5c92389 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d35c64f3a748da9075622e08283aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8329fbf83b104200a04faaa9c454d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:36:59.901629 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-7831f027-4808-4e44-86e8-51fad5c92389 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] 10.222.0.62 "GET /compute/v2.1/servers/259e6936-b56d-40bb-8581-afaff6f88644" status: 200 len: 1319 microversion: 2.1 time: 0.155676 Aug 10 11:36:59.902192 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 259/518] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:36:59 2022] GET /compute/v2.1/servers/259e6936-b56d-40bb-8581-afaff6f88644 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:00.546776 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-94b6350d-dfcb-464a-956b-f510366a85ed req-6d6b0cd6-dd26-47f3-9450-dbc13750c9d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f70dab9f-931f-4e70-bb09-0a053d3220a5", "tag": "53b710b6-9aea-4621-bdee-7da9637f2bfd"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:37:00.558373 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-94b6350d-dfcb-464a-956b-f510366a85ed req-6d6b0cd6-dd26-47f3-9450-dbc13750c9d8 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:00.558852 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-94b6350d-dfcb-464a-956b-f510366a85ed req-6d6b0cd6-dd26-47f3-9450-dbc13750c9d8 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:00.559289 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-94b6350d-dfcb-464a-956b-f510366a85ed req-6d6b0cd6-dd26-47f3-9450-dbc13750c9d8 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:00.571345 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-94b6350d-dfcb-464a-956b-f510366a85ed req-6d6b0cd6-dd26-47f3-9450-dbc13750c9d8 service nova] Creating event network-changed:53b710b6-9aea-4621-bdee-7da9637f2bfd for instance f70dab9f-931f-4e70-bb09-0a053d3220a5 on hv-cinder-85272 Aug 10 11:37:00.576886 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-94b6350d-dfcb-464a-956b-f510366a85ed req-6d6b0cd6-dd26-47f3-9450-dbc13750c9d8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033980 Aug 10 11:37:00.577472 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 260/519] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:37:00.672586 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-04cb4660-0867-4387-9ed4-59ebb25cfcdf tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:00.674825 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-04cb4660-0867-4387-9ed4-59ebb25cfcdf tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:00.681875 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-04cb4660-0867-4387-9ed4-59ebb25cfcdf tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:00.682371 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-04cb4660-0867-4387-9ed4-59ebb25cfcdf tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:00.682809 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-04cb4660-0867-4387-9ed4-59ebb25cfcdf tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:00.683538 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-04cb4660-0867-4387-9ed4-59ebb25cfcdf tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:00.684012 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-04cb4660-0867-4387-9ed4-59ebb25cfcdf tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:00.684441 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-04cb4660-0867-4387-9ed4-59ebb25cfcdf tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:00.714300 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-04cb4660-0867-4387-9ed4-59ebb25cfcdf tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045706 Aug 10 11:37:00.714869 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 260/520] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 10 11:37:00 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:00.776314 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-becfa1d1-1531-4aa2-b560-876e3e8635b2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:00.776950 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-becfa1d1-1531-4aa2-b560-876e3e8635b2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:00.782898 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-becfa1d1-1531-4aa2-b560-876e3e8635b2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:00.783383 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-becfa1d1-1531-4aa2-b560-876e3e8635b2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:00.783819 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-becfa1d1-1531-4aa2-b560-876e3e8635b2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:00.784528 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-becfa1d1-1531-4aa2-b560-876e3e8635b2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:00.784986 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-becfa1d1-1531-4aa2-b560-876e3e8635b2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:00.785414 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-becfa1d1-1531-4aa2-b560-876e3e8635b2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:00.817795 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-becfa1d1-1531-4aa2-b560-876e3e8635b2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Going to try to terminate instance {{(pid=124682) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:37:00.922836 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-4101776f-4640-4fc0-954f-a04a64426a42 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:00.923458 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-4101776f-4640-4fc0-954f-a04a64426a42 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 259e6936-b56d-40bb-8581-afaff6f88644] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:00.930813 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4101776f-4640-4fc0-954f-a04a64426a42 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:00.930813 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4101776f-4640-4fc0-954f-a04a64426a42 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:00.931249 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4101776f-4640-4fc0-954f-a04a64426a42 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:00.931982 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4101776f-4640-4fc0-954f-a04a64426a42 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:00.932450 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4101776f-4640-4fc0-954f-a04a64426a42 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:00.932878 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4101776f-4640-4fc0-954f-a04a64426a42 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:01.023937 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-becfa1d1-1531-4aa2-b560-876e3e8635b2 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "DELETE /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 204 len: 0 microversion: 2.20 time: 0.251497 Aug 10 11:37:01.024572 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 261/521] 10.222.0.62 () {60 vars in 1280 bytes} [Wed Aug 10 11:37:00 2022] DELETE /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 10 11:37:01.033139 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-a16ddf1e-1be4-4b90-9a38-26d6e03e018a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:01.034368 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-a16ddf1e-1be4-4b90-9a38-26d6e03e018a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:01.040193 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a16ddf1e-1be4-4b90-9a38-26d6e03e018a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:01.040693 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a16ddf1e-1be4-4b90-9a38-26d6e03e018a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:01.041138 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a16ddf1e-1be4-4b90-9a38-26d6e03e018a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:01.041841 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a16ddf1e-1be4-4b90-9a38-26d6e03e018a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:01.042329 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a16ddf1e-1be4-4b90-9a38-26d6e03e018a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:01.042722 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a16ddf1e-1be4-4b90-9a38-26d6e03e018a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:01.070104 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-4101776f-4640-4fc0-954f-a04a64426a42 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d35c64f3a748da9075622e08283aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8329fbf83b104200a04faaa9c454d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:01.078469 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-4101776f-4640-4fc0-954f-a04a64426a42 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] 10.222.0.62 "GET /compute/v2.1/servers/259e6936-b56d-40bb-8581-afaff6f88644" status: 200 len: 1319 microversion: 2.1 time: 0.159403 Aug 10 11:37:01.079136 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 261/522] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:00 2022] GET /compute/v2.1/servers/259e6936-b56d-40bb-8581-afaff6f88644 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:37:01.394422 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-a16ddf1e-1be4-4b90-9a38-26d6e03e018a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:01.403246 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-a16ddf1e-1be4-4b90-9a38-26d6e03e018a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:01.404793 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-a16ddf1e-1be4-4b90-9a38-26d6e03e018a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:01.405954 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-a16ddf1e-1be4-4b90-9a38-26d6e03e018a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1723 microversion: 2.20 time: 0.376842 Aug 10 11:37:01.406508 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 262/523] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:37:01 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1723 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:37:02.098725 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f65682d1-cafb-4e6d-8232-636415be6717 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:02.099348 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-f65682d1-cafb-4e6d-8232-636415be6717 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 259e6936-b56d-40bb-8581-afaff6f88644] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:02.106549 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f65682d1-cafb-4e6d-8232-636415be6717 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:02.107052 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f65682d1-cafb-4e6d-8232-636415be6717 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:02.107482 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f65682d1-cafb-4e6d-8232-636415be6717 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:02.108187 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f65682d1-cafb-4e6d-8232-636415be6717 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:02.108638 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f65682d1-cafb-4e6d-8232-636415be6717 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:02.109056 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f65682d1-cafb-4e6d-8232-636415be6717 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:02.241655 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-f65682d1-cafb-4e6d-8232-636415be6717 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d35c64f3a748da9075622e08283aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8329fbf83b104200a04faaa9c454d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:02.249110 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-f65682d1-cafb-4e6d-8232-636415be6717 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] 10.222.0.62 "GET /compute/v2.1/servers/259e6936-b56d-40bb-8581-afaff6f88644" status: 200 len: 1507 microversion: 2.1 time: 0.154269 Aug 10 11:37:02.249682 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 262/524] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:02 2022] GET /compute/v2.1/servers/259e6936-b56d-40bb-8581-afaff6f88644 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:02.269915 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-712e5232-2a4a-40e4-9039-c27ab01bdad9 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "82d9aa4a-17d6-4354-b23c-b11fa1f660a4", "device": "/dev/sdb"}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:37:02.272385 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-712e5232-2a4a-40e4-9039-c27ab01bdad9 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 259e6936-b56d-40bb-8581-afaff6f88644] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:02.279620 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-712e5232-2a4a-40e4-9039-c27ab01bdad9 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:02.280164 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-712e5232-2a4a-40e4-9039-c27ab01bdad9 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:02.280598 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-712e5232-2a4a-40e4-9039-c27ab01bdad9 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:02.281275 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-712e5232-2a4a-40e4-9039-c27ab01bdad9 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:02.281725 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-712e5232-2a4a-40e4-9039-c27ab01bdad9 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:02.282147 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-712e5232-2a4a-40e4-9039-c27ab01bdad9 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:02.428444 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-0578f60b-95ba-42e8-bd6b-b6a6cacf9f23 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:02.428976 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-0578f60b-95ba-42e8-bd6b-b6a6cacf9f23 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:02.443008 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0578f60b-95ba-42e8-bd6b-b6a6cacf9f23 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:02.443495 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0578f60b-95ba-42e8-bd6b-b6a6cacf9f23 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:02.443928 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0578f60b-95ba-42e8-bd6b-b6a6cacf9f23 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:02.444654 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0578f60b-95ba-42e8-bd6b-b6a6cacf9f23 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:02.445108 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0578f60b-95ba-42e8-bd6b-b6a6cacf9f23 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:02.445539 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0578f60b-95ba-42e8-bd6b-b6a6cacf9f23 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:02.577536 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-0578f60b-95ba-42e8-bd6b-b6a6cacf9f23 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:02.585318 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-0578f60b-95ba-42e8-bd6b-b6a6cacf9f23 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:02.588045 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-0578f60b-95ba-42e8-bd6b-b6a6cacf9f23 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:02.589208 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-0578f60b-95ba-42e8-bd6b-b6a6cacf9f23 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1723 microversion: 2.20 time: 0.164773 Aug 10 11:37:02.589748 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 263/525] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:37:02 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:37:03.613091 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-06fa191b-d5aa-4387-bc52-386113612382 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:03.613720 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-06fa191b-d5aa-4387-bc52-386113612382 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:03.620401 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-06fa191b-d5aa-4387-bc52-386113612382 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:03.620888 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-06fa191b-d5aa-4387-bc52-386113612382 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:03.621331 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-06fa191b-d5aa-4387-bc52-386113612382 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:03.622058 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-06fa191b-d5aa-4387-bc52-386113612382 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:03.622505 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-06fa191b-d5aa-4387-bc52-386113612382 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:03.622924 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-06fa191b-d5aa-4387-bc52-386113612382 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:03.720454 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-712e5232-2a4a-40e4-9039-c27ab01bdad9 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] 10.222.0.62 "POST /compute/v2.1/servers/259e6936-b56d-40bb-8581-afaff6f88644/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.454073 Aug 10 11:37:03.726856 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 263/526] 10.222.0.62 () {60 vars in 1323 bytes} [Wed Aug 10 11:37:02 2022] POST /compute/v2.1/servers/259e6936-b56d-40bb-8581-afaff6f88644/os-volume_attachments => generated 194 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:37:03.768440 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-06fa191b-d5aa-4387-bc52-386113612382 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:03.777716 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-06fa191b-d5aa-4387-bc52-386113612382 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:03.779251 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-06fa191b-d5aa-4387-bc52-386113612382 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:03.780457 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-06fa191b-d5aa-4387-bc52-386113612382 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1723 microversion: 2.20 time: 0.172806 Aug 10 11:37:03.783997 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 264/527] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:37:03 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:37:04.378810 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-75a25a6f-955a-40d5-8da7-88fabc17d5e6 req-b201a3aa-041a-4191-8b43-469d942e4a99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e6ed242-956f-4b14-8520-18920447bf05", "name": "network-vif-deleted", "tag": "f3f3926f-a2b3-40b5-a25f-a37b15cc0401"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:37:04.389002 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-75a25a6f-955a-40d5-8da7-88fabc17d5e6 req-b201a3aa-041a-4191-8b43-469d942e4a99 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:04.389490 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-75a25a6f-955a-40d5-8da7-88fabc17d5e6 req-b201a3aa-041a-4191-8b43-469d942e4a99 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:04.391081 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-75a25a6f-955a-40d5-8da7-88fabc17d5e6 req-b201a3aa-041a-4191-8b43-469d942e4a99 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:04.402479 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-75a25a6f-955a-40d5-8da7-88fabc17d5e6 req-b201a3aa-041a-4191-8b43-469d942e4a99 service nova] Creating event network-vif-deleted:f3f3926f-a2b3-40b5-a25f-a37b15cc0401 for instance 9e6ed242-956f-4b14-8520-18920447bf05 on hv-cinder-85272 Aug 10 11:37:04.407345 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-75a25a6f-955a-40d5-8da7-88fabc17d5e6 req-b201a3aa-041a-4191-8b43-469d942e4a99 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032537 Aug 10 11:37:04.407943 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 264/528] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:37:04.806672 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-5a247b27-7206-4e1f-888a-898b2a28669d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:04.807872 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-5a247b27-7206-4e1f-888a-898b2a28669d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:04.816184 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5a247b27-7206-4e1f-888a-898b2a28669d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:04.816913 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5a247b27-7206-4e1f-888a-898b2a28669d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:04.817519 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5a247b27-7206-4e1f-888a-898b2a28669d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:04.818404 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5a247b27-7206-4e1f-888a-898b2a28669d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:04.819379 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5a247b27-7206-4e1f-888a-898b2a28669d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:04.819991 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5a247b27-7206-4e1f-888a-898b2a28669d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:04.857686 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5a247b27-7206-4e1f-888a-898b2a28669d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:04.858171 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5a247b27-7206-4e1f-888a-898b2a28669d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:04.858609 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5a247b27-7206-4e1f-888a-898b2a28669d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:04.859069 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.objects.instance [None req-5a247b27-7206-4e1f-888a-898b2a28669d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lazy-loading 'fault' on Instance uuid 9e6ed242-956f-4b14-8520-18920447bf05 {{(pid=124683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:37:04.918826 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-5a247b27-7206-4e1f-888a-898b2a28669d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:04.929499 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-5a247b27-7206-4e1f-888a-898b2a28669d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:04.932132 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-5a247b27-7206-4e1f-888a-898b2a28669d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:04.933300 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-5a247b27-7206-4e1f-888a-898b2a28669d tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 200 len: 1370 microversion: 2.20 time: 0.131082 Aug 10 11:37:04.933860 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 265/529] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:37:04 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 1370 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:37:05.956452 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-888eee00-a0a1-4721-b211-01e38d3180f8 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:05.957251 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-888eee00-a0a1-4721-b211-01e38d3180f8 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:05.964534 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-888eee00-a0a1-4721-b211-01e38d3180f8 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:05.965102 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-888eee00-a0a1-4721-b211-01e38d3180f8 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:05.965542 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-888eee00-a0a1-4721-b211-01e38d3180f8 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:05.966257 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-888eee00-a0a1-4721-b211-01e38d3180f8 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:05.966712 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-888eee00-a0a1-4721-b211-01e38d3180f8 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:05.967136 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-888eee00-a0a1-4721-b211-01e38d3180f8 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:05.980779 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.wsgi [None req-888eee00-a0a1-4721-b211-01e38d3180f8 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] HTTP exception thrown: Instance 9e6ed242-956f-4b14-8520-18920447bf05 could not be found. Aug 10 11:37:05.982485 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-888eee00-a0a1-4721-b211-01e38d3180f8 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Request method failure captured: Aug 10 11:37:05.982485 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: request: GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 HTTP/1.1 Aug 10 11:37:05.982485 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Accept: application/json Aug 10 11:37:05.982485 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Aug 10 11:37:05.982485 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Connection: close Aug 10 11:37:05.982485 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Content-Length: 0 Aug 10 11:37:05.982485 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Content-Type: application/json Aug 10 11:37:05.982485 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Host: 10.222.0.62 Aug 10 11:37:05.982485 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Aug 10 11:37:05.982485 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.11 Aug 10 11:37:05.982485 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABi85dbPpkD1lR6RgeGxs20S9zIpw9_vWmHYwF3S3efUNWpa3XkvYBD_qP6zOAi-1YEMOe9G-Nqxrr80D-z8SZs034-HRTFI0Jc1vEbrcFlCMHBEnhSQC8MmaTwEs8VeOUyk0d7je2_5L6HblSoU8Ec68jOZAZkEjpVrGpZ3jFH507P8oA Aug 10 11:37:05.982485 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Aug 10 11:37:05.982485 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Aug 10 11:37:05.982485 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Aug 10 11:37:05.982485 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Aug 10 11:37:05.982485 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 11:37:05.982485 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Aug 10 11:37:05.982485 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Aug 10 11:37:05.982485 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Id: bc3366c89fa049939147e3761e0c8d1a Aug 10 11:37:05.982485 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-671694811 Aug 10 11:37:05.982485 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Role: member,reader Aug 10 11:37:05.982485 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Aug 10 11:37:05.984172 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bc3366c89fa049939147e3761e0c8d1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bc3366c89fa049939147e3761e0c8d1a", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bc3366c89fa049939147e3761e0c8d1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bc3366c89fa049939147e3761e0c8d1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:37:05.984172 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-AttachVolumeShelveTestJSON-671694811 Aug 10 11:37:05.984172 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant-Id: bc3366c89fa049939147e3761e0c8d1a Aug 10 11:37:05.984172 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-671694811 Aug 10 11:37:05.984172 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User: tempest-AttachVolumeShelveTestJSON-671694811-project Aug 10 11:37:05.984172 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Aug 10 11:37:05.984172 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Aug 10 11:37:05.984172 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Id: 84c1f36162fa4537923cd19f21bbd20c Aug 10 11:37:05.984172 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-AttachVolumeShelveTestJSON-671694811-project Aug 10 11:37:05.984172 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: method: > Aug 10 11:37:05.984172 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: exception: Instance 9e6ed242-956f-4b14-8520-18920447bf05 could not be found. Aug 10 11:37:05.984172 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: action_args: {'id': '9e6ed242-956f-4b14-8520-18920447bf05'} Aug 10 11:37:05.985009 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:37:05.985009 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:37:05.985009 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:37:05.985009 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:37:05.985009 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:37:05.985009 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:37:05.985009 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:37:05.985009 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:37:05.985009 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:37:05.985009 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:37:05.985009 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e6ed242-956f-4b14-8520-18920447bf05 could not be found. Aug 10 11:37:05.985009 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:37:05.985009 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:37:05.985009 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:37:05.985009 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:37:05.985009 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:37:05.985009 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:37:05.985009 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:37:05.985009 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:37:05.985009 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:37:05.986229 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:37:05.986229 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:37:05.986229 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:37:05.986229 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:37:05.986229 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:37:05.986229 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:37:05.986229 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:37:05.986229 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e6ed242-956f-4b14-8520-18920447bf05 could not be found. Aug 10 11:37:05.986229 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:37:05.986229 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:37:05.986229 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:37:05.986229 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:37:05.986229 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:37:05.986229 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:37:05.986229 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:37:05.986229 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:37:05.986229 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e6ed242-956f-4b14-8520-18920447bf05 could not be found. Aug 10 11:37:05.986229 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:37:05.987299 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-888eee00-a0a1-4721-b211-01e38d3180f8 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Returning 404 to user: Instance 9e6ed242-956f-4b14-8520-18920447bf05 could not be found. {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:37:05.987299 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-888eee00-a0a1-4721-b211-01e38d3180f8 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 404 len: 111 microversion: 2.20 time: 0.031608 Aug 10 11:37:05.987299 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 265/530] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:37:05 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 11:37:05.993266 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-b64b7258-4edc-4349-a0dd-a4816d43074b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '.version_select at 0x7fb7cdc82b80>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:06.070758 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-b64b7258-4edc-4349-a0dd-a4816d43074b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-149698831" status: 204 len: 0 microversion: 2.20 time: 0.081758 Aug 10 11:37:06.071251 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 266/531] 10.222.0.62 () {60 vars in 1259 bytes} [Wed Aug 10 11:37:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-149698831 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 11:37:07.106563 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-770e6d39-2999-4508-8e78-345752b1f460 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Action: 'create', calling method: .version_select at 0x7fb7ce4b6310>, body: {"keypair": {"name": "tempest-keypair-495525057", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJ39j6k5gQeDL/p2AUYwPRQnBV0eMEBo1EkCH2OdZQySqLmVfUT5wVO2Og1EO0xA6weryHdq5VFCciOdUDi6AL35dXq/rBJAMWv1JMdpXgE7WlVRSK+QI1byuxq9Bowpg=="}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:37:07.126469 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-770e6d39-2999-4508-8e78-345752b1f460 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Getting quotas for project bc3366c89fa049939147e3761e0c8d1a. Resources: {'key_pairs'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:37:07.130201 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-770e6d39-2999-4508-8e78-345752b1f460 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Getting quotas for user 84c1f36162fa4537923cd19f21bbd20c and project bc3366c89fa049939147e3761e0c8d1a. Resources: {'key_pairs'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:37:07.219473 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-770e6d39-2999-4508-8e78-345752b1f460 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.116923 Aug 10 11:37:07.220092 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 266/532] 10.222.0.62 () {62 vars in 1200 bytes} [Wed Aug 10 11:37:07 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 118 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 10 11:37:09.444616 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-0c8d3132-0c46-4880-8842-5dffb7619c0f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1911308839", "imageRef": "99bbc441-5102-4a51-a496-cfbffeb3033a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a343c28e-970e-43e5-9083-e849cc490dbe"}], "security_groups": [{"name": "tempest-securitygroup--999967642"}], "key_name": "tempest-keypair-495525057", "user_data": "}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:37:09.551084 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.network.neutron [None req-0c8d3132-0c46-4880-8842-5dffb7619c0f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] validate_networks() for [('a343c28e-970e-43e5-9083-e849cc490dbe', None, None, None, None, None)] {{(pid=124683) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:37:09.929418 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-0c8d3132-0c46-4880-8842-5dffb7619c0f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Flavor limits 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:37:09.929950 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-0c8d3132-0c46-4880-8842-5dffb7619c0f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Image limits 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:37:09.930421 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-0c8d3132-0c46-4880-8842-5dffb7619c0f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Flavor pref 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:37:09.930826 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-0c8d3132-0c46-4880-8842-5dffb7619c0f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Image pref 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:37:09.931234 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-0c8d3132-0c46-4880-8842-5dffb7619c0f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:37:09.939897 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0c8d3132-0c46-4880-8842-5dffb7619c0f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:09.940395 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0c8d3132-0c46-4880-8842-5dffb7619c0f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:09.940827 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0c8d3132-0c46-4880-8842-5dffb7619c0f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:09.941538 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0c8d3132-0c46-4880-8842-5dffb7619c0f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:09.941987 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0c8d3132-0c46-4880-8842-5dffb7619c0f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:09.942408 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0c8d3132-0c46-4880-8842-5dffb7619c0f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:09.958981 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-0c8d3132-0c46-4880-8842-5dffb7619c0f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Getting quotas for project bc3366c89fa049939147e3761e0c8d1a. Resources: {'ram', 'instances', 'cores'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:37:09.963564 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-0c8d3132-0c46-4880-8842-5dffb7619c0f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Getting quotas for user 84c1f36162fa4537923cd19f21bbd20c and project bc3366c89fa049939147e3761e0c8d1a. Resources: {'ram', 'instances', 'cores'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:37:09.974213 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-0c8d3132-0c46-4880-8842-5dffb7619c0f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Going to run 1 instances... {{(pid=124683) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:37:09.977100 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-0c8d3132-0c46-4880-8842-5dffb7619c0f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99bbc441-5102-4a51-a496-cfbffeb3033a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124683) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:37:10.130109 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-0c8d3132-0c46-4880-8842-5dffb7619c0f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.690260 Aug 10 11:37:10.135284 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 267/533] 10.222.0.62 () {62 vars in 1188 bytes} [Wed Aug 10 11:37:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 10 11:37:10.145368 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-6a6d76b9-49ec-4bf9-a6b3-27a32fcfbf0c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:10.146652 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-6a6d76b9-49ec-4bf9-a6b3-27a32fcfbf0c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:10.220678 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-6a6d76b9-49ec-4bf9-a6b3-27a32fcfbf0c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:10.229603 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-6a6d76b9-49ec-4bf9-a6b3-27a32fcfbf0c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:10.231284 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-6a6d76b9-49ec-4bf9-a6b3-27a32fcfbf0c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:10.232583 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-6a6d76b9-49ec-4bf9-a6b3-27a32fcfbf0c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1281 microversion: 2.20 time: 0.091160 Aug 10 11:37:10.249980 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 267/534] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:37:10 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1281 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:37:11.278849 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-2b4b4458-fb43-441d-a6cf-c81a82b182af tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:11.278849 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-2b4b4458-fb43-441d-a6cf-c81a82b182af tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:11.278849 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2b4b4458-fb43-441d-a6cf-c81a82b182af tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:11.279658 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2b4b4458-fb43-441d-a6cf-c81a82b182af tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:11.279831 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2b4b4458-fb43-441d-a6cf-c81a82b182af tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:11.280685 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2b4b4458-fb43-441d-a6cf-c81a82b182af tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:11.281094 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2b4b4458-fb43-441d-a6cf-c81a82b182af tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:11.281499 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2b4b4458-fb43-441d-a6cf-c81a82b182af tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:11.346764 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-2b4b4458-fb43-441d-a6cf-c81a82b182af tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:11.355607 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-2b4b4458-fb43-441d-a6cf-c81a82b182af tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:11.357800 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-2b4b4458-fb43-441d-a6cf-c81a82b182af tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:11.358899 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-2b4b4458-fb43-441d-a6cf-c81a82b182af tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1277 microversion: 2.20 time: 0.091945 Aug 10 11:37:11.359449 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 268/535] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:37:11 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1277 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:37:12.382323 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-3c80b4fb-3ae5-476f-b280-02422df3cf28 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:12.382931 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-3c80b4fb-3ae5-476f-b280-02422df3cf28 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:12.389571 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3c80b4fb-3ae5-476f-b280-02422df3cf28 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:12.390054 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3c80b4fb-3ae5-476f-b280-02422df3cf28 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:12.390744 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3c80b4fb-3ae5-476f-b280-02422df3cf28 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:12.391437 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3c80b4fb-3ae5-476f-b280-02422df3cf28 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:12.391891 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3c80b4fb-3ae5-476f-b280-02422df3cf28 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:12.392494 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3c80b4fb-3ae5-476f-b280-02422df3cf28 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:12.452308 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-3c80b4fb-3ae5-476f-b280-02422df3cf28 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:12.460211 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-3c80b4fb-3ae5-476f-b280-02422df3cf28 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:12.461704 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-3c80b4fb-3ae5-476f-b280-02422df3cf28 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:12.462860 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-3c80b4fb-3ae5-476f-b280-02422df3cf28 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1341 microversion: 2.20 time: 0.084383 Aug 10 11:37:12.463415 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 268/536] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:37:12 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1341 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:37:13.491734 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-536c25cf-27dc-4687-9d13-085cc51bcdc4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:13.492304 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-536c25cf-27dc-4687-9d13-085cc51bcdc4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:13.498209 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-536c25cf-27dc-4687-9d13-085cc51bcdc4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:13.498689 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-536c25cf-27dc-4687-9d13-085cc51bcdc4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:13.499120 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-536c25cf-27dc-4687-9d13-085cc51bcdc4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:13.499797 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-536c25cf-27dc-4687-9d13-085cc51bcdc4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:13.500275 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-536c25cf-27dc-4687-9d13-085cc51bcdc4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:13.500698 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-536c25cf-27dc-4687-9d13-085cc51bcdc4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:13.564180 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-536c25cf-27dc-4687-9d13-085cc51bcdc4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:13.572281 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-536c25cf-27dc-4687-9d13-085cc51bcdc4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:13.573822 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-536c25cf-27dc-4687-9d13-085cc51bcdc4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:13.574925 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-536c25cf-27dc-4687-9d13-085cc51bcdc4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1341 microversion: 2.20 time: 0.087312 Aug 10 11:37:13.575487 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 269/537] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:37:13 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1341 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:37:14.596869 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-0613d2fa-58f6-40be-a83a-419b94e1888a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:14.597482 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-0613d2fa-58f6-40be-a83a-419b94e1888a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:14.603940 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0613d2fa-58f6-40be-a83a-419b94e1888a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:14.604450 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0613d2fa-58f6-40be-a83a-419b94e1888a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:14.605399 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0613d2fa-58f6-40be-a83a-419b94e1888a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:14.606135 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0613d2fa-58f6-40be-a83a-419b94e1888a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:14.606586 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0613d2fa-58f6-40be-a83a-419b94e1888a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:14.607014 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0613d2fa-58f6-40be-a83a-419b94e1888a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:14.671564 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-0613d2fa-58f6-40be-a83a-419b94e1888a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:14.679794 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-0613d2fa-58f6-40be-a83a-419b94e1888a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:14.681349 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-0613d2fa-58f6-40be-a83a-419b94e1888a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:14.682439 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-0613d2fa-58f6-40be-a83a-419b94e1888a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1341 microversion: 2.20 time: 0.089454 Aug 10 11:37:14.683721 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 269/538] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:37:14 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1341 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:37:15.705091 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-6ca1fbd9-ddb6-4b8f-9bc8-ddeb24d4fa7f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:15.705704 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-6ca1fbd9-ddb6-4b8f-9bc8-ddeb24d4fa7f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:15.711949 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6ca1fbd9-ddb6-4b8f-9bc8-ddeb24d4fa7f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:15.712682 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6ca1fbd9-ddb6-4b8f-9bc8-ddeb24d4fa7f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:15.713116 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6ca1fbd9-ddb6-4b8f-9bc8-ddeb24d4fa7f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:15.714311 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6ca1fbd9-ddb6-4b8f-9bc8-ddeb24d4fa7f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:15.714311 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6ca1fbd9-ddb6-4b8f-9bc8-ddeb24d4fa7f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:15.714785 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6ca1fbd9-ddb6-4b8f-9bc8-ddeb24d4fa7f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:15.860512 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-6ca1fbd9-ddb6-4b8f-9bc8-ddeb24d4fa7f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:15.870116 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-6ca1fbd9-ddb6-4b8f-9bc8-ddeb24d4fa7f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:15.873045 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-6ca1fbd9-ddb6-4b8f-9bc8-ddeb24d4fa7f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:15.875625 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-6ca1fbd9-ddb6-4b8f-9bc8-ddeb24d4fa7f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1406 microversion: 2.20 time: 0.174411 Aug 10 11:37:15.891620 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 270/539] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:37:15 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1406 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:37:16.576559 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-cb8bab68-a433-4b22-a70d-95f0cf35abba req-502198f9-2bde-4464-9c3f-5141cb87d159 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "865edaf1-a2d9-492e-af4c-05e5aecd6cf8", "tag": "61acbadb-ed19-49d1-a43f-0e58327b568a"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:37:16.586286 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-cb8bab68-a433-4b22-a70d-95f0cf35abba req-502198f9-2bde-4464-9c3f-5141cb87d159 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:16.586752 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-cb8bab68-a433-4b22-a70d-95f0cf35abba req-502198f9-2bde-4464-9c3f-5141cb87d159 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:16.587195 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-cb8bab68-a433-4b22-a70d-95f0cf35abba req-502198f9-2bde-4464-9c3f-5141cb87d159 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:16.598180 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-cb8bab68-a433-4b22-a70d-95f0cf35abba req-502198f9-2bde-4464-9c3f-5141cb87d159 service nova] Creating event network-changed:61acbadb-ed19-49d1-a43f-0e58327b568a for instance 865edaf1-a2d9-492e-af4c-05e5aecd6cf8 on hv-cinder-85272 Aug 10 11:37:16.603044 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-cb8bab68-a433-4b22-a70d-95f0cf35abba req-502198f9-2bde-4464-9c3f-5141cb87d159 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030297 Aug 10 11:37:16.603636 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 270/540] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:37:16.899852 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-1f88769d-a34a-4a9a-adc0-369ed38e6356 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:16.900546 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-1f88769d-a34a-4a9a-adc0-369ed38e6356 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:16.907406 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1f88769d-a34a-4a9a-adc0-369ed38e6356 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:16.907883 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1f88769d-a34a-4a9a-adc0-369ed38e6356 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:16.908349 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1f88769d-a34a-4a9a-adc0-369ed38e6356 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:16.909036 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1f88769d-a34a-4a9a-adc0-369ed38e6356 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:16.909471 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1f88769d-a34a-4a9a-adc0-369ed38e6356 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:16.909896 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1f88769d-a34a-4a9a-adc0-369ed38e6356 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:17.039611 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-1f88769d-a34a-4a9a-adc0-369ed38e6356 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:17.048259 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-1f88769d-a34a-4a9a-adc0-369ed38e6356 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:17.049752 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-1f88769d-a34a-4a9a-adc0-369ed38e6356 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:17.050843 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-1f88769d-a34a-4a9a-adc0-369ed38e6356 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1406 microversion: 2.20 time: 0.154965 Aug 10 11:37:17.051401 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 271/541] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:37:16 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:37:18.075457 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-feca5b32-88cd-429f-b09e-04d73321a844 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:18.076184 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-feca5b32-88cd-429f-b09e-04d73321a844 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:18.078105 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:37:18.082991 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-feca5b32-88cd-429f-b09e-04d73321a844 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:18.083476 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-feca5b32-88cd-429f-b09e-04d73321a844 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:18.083918 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-feca5b32-88cd-429f-b09e-04d73321a844 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:18.084636 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-feca5b32-88cd-429f-b09e-04d73321a844 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:18.085091 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-feca5b32-88cd-429f-b09e-04d73321a844 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:18.085598 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-feca5b32-88cd-429f-b09e-04d73321a844 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:18.220538 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-feca5b32-88cd-429f-b09e-04d73321a844 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:18.228501 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-feca5b32-88cd-429f-b09e-04d73321a844 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:18.230580 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-feca5b32-88cd-429f-b09e-04d73321a844 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:18.231702 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-feca5b32-88cd-429f-b09e-04d73321a844 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1406 microversion: 2.20 time: 0.161714 Aug 10 11:37:18.232504 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 271/542] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:37:18 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:37:19.254193 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-847262bb-716e-46d0-9a73-6add3ecdb01e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:19.254822 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-847262bb-716e-46d0-9a73-6add3ecdb01e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:19.257237 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:37:19.262539 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-847262bb-716e-46d0-9a73-6add3ecdb01e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:19.269418 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-847262bb-716e-46d0-9a73-6add3ecdb01e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:19.269418 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-847262bb-716e-46d0-9a73-6add3ecdb01e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:19.269418 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-847262bb-716e-46d0-9a73-6add3ecdb01e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:19.269418 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-847262bb-716e-46d0-9a73-6add3ecdb01e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:19.269796 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-847262bb-716e-46d0-9a73-6add3ecdb01e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:19.404927 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-847262bb-716e-46d0-9a73-6add3ecdb01e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:19.413045 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-847262bb-716e-46d0-9a73-6add3ecdb01e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:19.414575 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-847262bb-716e-46d0-9a73-6add3ecdb01e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:19.415663 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-847262bb-716e-46d0-9a73-6add3ecdb01e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1406 microversion: 2.20 time: 0.165404 Aug 10 11:37:19.416371 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 272/543] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:37:19 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:37:20.438477 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-5b550016-e65c-4e41-b774-772036da6bc0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:20.439005 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-5b550016-e65c-4e41-b774-772036da6bc0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:20.441285 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=6 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:37:20.449097 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5b550016-e65c-4e41-b774-772036da6bc0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:20.449585 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5b550016-e65c-4e41-b774-772036da6bc0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:20.451952 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5b550016-e65c-4e41-b774-772036da6bc0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:20.451952 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5b550016-e65c-4e41-b774-772036da6bc0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:20.451952 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5b550016-e65c-4e41-b774-772036da6bc0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:20.451952 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5b550016-e65c-4e41-b774-772036da6bc0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:20.590719 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-5b550016-e65c-4e41-b774-772036da6bc0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:20.598844 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-5b550016-e65c-4e41-b774-772036da6bc0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:20.600380 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-5b550016-e65c-4e41-b774-772036da6bc0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:20.601476 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-5b550016-e65c-4e41-b774-772036da6bc0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1406 microversion: 2.20 time: 0.166915 Aug 10 11:37:20.602033 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 272/544] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:37:20 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:37:21.624537 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-daa5eb50-21af-4496-8fcd-780e07d95885 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:21.625144 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-daa5eb50-21af-4496-8fcd-780e07d95885 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:21.627083 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=2 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:37:21.627742 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=6 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:37:21.633168 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-daa5eb50-21af-4496-8fcd-780e07d95885 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:21.633892 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-daa5eb50-21af-4496-8fcd-780e07d95885 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:21.634100 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-daa5eb50-21af-4496-8fcd-780e07d95885 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:21.634839 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-daa5eb50-21af-4496-8fcd-780e07d95885 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:21.635295 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-daa5eb50-21af-4496-8fcd-780e07d95885 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:21.635720 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-daa5eb50-21af-4496-8fcd-780e07d95885 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:21.767904 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-daa5eb50-21af-4496-8fcd-780e07d95885 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:21.775899 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-daa5eb50-21af-4496-8fcd-780e07d95885 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:21.777593 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-daa5eb50-21af-4496-8fcd-780e07d95885 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:21.778685 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-daa5eb50-21af-4496-8fcd-780e07d95885 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1406 microversion: 2.20 time: 0.159315 Aug 10 11:37:21.779246 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 273/545] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:37:21 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:37:22.800626 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-94f63eec-47f2-4794-9db0-29b5fbabd1a0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:22.801242 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-94f63eec-47f2-4794-9db0-29b5fbabd1a0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:22.807670 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-94f63eec-47f2-4794-9db0-29b5fbabd1a0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:22.808195 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-94f63eec-47f2-4794-9db0-29b5fbabd1a0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:22.808640 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-94f63eec-47f2-4794-9db0-29b5fbabd1a0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:22.809337 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-94f63eec-47f2-4794-9db0-29b5fbabd1a0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:22.809796 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-94f63eec-47f2-4794-9db0-29b5fbabd1a0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:22.810224 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-94f63eec-47f2-4794-9db0-29b5fbabd1a0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:22.814079 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:37:22.936993 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-94f63eec-47f2-4794-9db0-29b5fbabd1a0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:22.944684 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-94f63eec-47f2-4794-9db0-29b5fbabd1a0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:22.946203 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-94f63eec-47f2-4794-9db0-29b5fbabd1a0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:22.947411 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-94f63eec-47f2-4794-9db0-29b5fbabd1a0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1406 microversion: 2.20 time: 0.150576 Aug 10 11:37:22.947951 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 273/546] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:37:22 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:37:23.815956 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-474dff27-59e3-490c-bd33-93fb76977c81 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:23.816499 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-474dff27-59e3-490c-bd33-93fb76977c81 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 259e6936-b56d-40bb-8581-afaff6f88644] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:23.822779 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-474dff27-59e3-490c-bd33-93fb76977c81 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:23.823299 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-474dff27-59e3-490c-bd33-93fb76977c81 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:23.824518 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-474dff27-59e3-490c-bd33-93fb76977c81 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:23.825285 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-474dff27-59e3-490c-bd33-93fb76977c81 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:23.825748 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-474dff27-59e3-490c-bd33-93fb76977c81 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:23.826182 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-474dff27-59e3-490c-bd33-93fb76977c81 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:23.907755 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.objects.instance [None req-474dff27-59e3-490c-bd33-93fb76977c81 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lazy-loading 'services' on Instance uuid 259e6936-b56d-40bb-8581-afaff6f88644 {{(pid=124683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:37:23.969968 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-306517fe-1ad4-421e-a259-fe430b1610aa tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:23.970552 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-306517fe-1ad4-421e-a259-fe430b1610aa tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:23.976844 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-306517fe-1ad4-421e-a259-fe430b1610aa tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:23.977321 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-306517fe-1ad4-421e-a259-fe430b1610aa tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:23.977751 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-306517fe-1ad4-421e-a259-fe430b1610aa tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:23.978428 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-306517fe-1ad4-421e-a259-fe430b1610aa tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:23.978875 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-306517fe-1ad4-421e-a259-fe430b1610aa tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:23.979292 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-306517fe-1ad4-421e-a259-fe430b1610aa tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:24.021416 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=100 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:37:24.074513 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-474dff27-59e3-490c-bd33-93fb76977c81 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] 10.222.0.62 "DELETE /compute/v2.1/servers/259e6936-b56d-40bb-8581-afaff6f88644/os-volume_attachments/82d9aa4a-17d6-4354-b23c-b11fa1f660a4" status: 202 len: 0 microversion: 2.1 time: 0.262282 Aug 10 11:37:24.075340 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 274/547] 10.222.0.62 () {58 vars in 1416 bytes} [Wed Aug 10 11:37:23 2022] DELETE /compute/v2.1/servers/259e6936-b56d-40bb-8581-afaff6f88644/os-volume_attachments/82d9aa4a-17d6-4354-b23c-b11fa1f660a4 => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:37:24.113554 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-306517fe-1ad4-421e-a259-fe430b1610aa tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:24.121862 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-306517fe-1ad4-421e-a259-fe430b1610aa tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:24.132707 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-306517fe-1ad4-421e-a259-fe430b1610aa tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:24.132707 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-306517fe-1ad4-421e-a259-fe430b1610aa tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1406 microversion: 2.20 time: 0.159377 Aug 10 11:37:24.132707 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 274/548] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:37:23 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:37:25.148015 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-8698fe4a-e9e9-42d9-95d5-4a684aff241f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:25.148718 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-8698fe4a-e9e9-42d9-95d5-4a684aff241f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:25.162111 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8698fe4a-e9e9-42d9-95d5-4a684aff241f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:25.162250 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8698fe4a-e9e9-42d9-95d5-4a684aff241f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:25.162670 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8698fe4a-e9e9-42d9-95d5-4a684aff241f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:25.163362 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8698fe4a-e9e9-42d9-95d5-4a684aff241f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:25.163902 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8698fe4a-e9e9-42d9-95d5-4a684aff241f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:25.164361 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8698fe4a-e9e9-42d9-95d5-4a684aff241f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:25.201068 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-4ba02ec1-06ad-416b-850d-effb7a41a2a1 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:25.205387 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-4ba02ec1-06ad-416b-850d-effb7a41a2a1 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 259e6936-b56d-40bb-8581-afaff6f88644] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:25.212542 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4ba02ec1-06ad-416b-850d-effb7a41a2a1 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:25.213276 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4ba02ec1-06ad-416b-850d-effb7a41a2a1 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:25.214128 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4ba02ec1-06ad-416b-850d-effb7a41a2a1 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:25.215096 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4ba02ec1-06ad-416b-850d-effb7a41a2a1 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:25.215821 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4ba02ec1-06ad-416b-850d-effb7a41a2a1 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:25.216501 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4ba02ec1-06ad-416b-850d-effb7a41a2a1 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:25.248756 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-4ba02ec1-06ad-416b-850d-effb7a41a2a1 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 259e6936-b56d-40bb-8581-afaff6f88644] Going to try to terminate instance {{(pid=124682) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:37:25.328043 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-8698fe4a-e9e9-42d9-95d5-4a684aff241f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:25.336294 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-8698fe4a-e9e9-42d9-95d5-4a684aff241f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:25.337841 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-8698fe4a-e9e9-42d9-95d5-4a684aff241f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:25.339636 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-8698fe4a-e9e9-42d9-95d5-4a684aff241f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1406 microversion: 2.20 time: 0.195168 Aug 10 11:37:25.340266 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 275/549] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:37:25 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1406 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:37:25.428859 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-77450472-fd20-4efd-8822-79a41e45d7ef req-fd97aad3-4bd9-4269-bdcc-228c33cd556e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "865edaf1-a2d9-492e-af4c-05e5aecd6cf8", "name": "network-vif-plugged", "status": "completed", "tag": "61acbadb-ed19-49d1-a43f-0e58327b568a"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:37:25.440724 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-77450472-fd20-4efd-8822-79a41e45d7ef req-fd97aad3-4bd9-4269-bdcc-228c33cd556e service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:25.441196 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-77450472-fd20-4efd-8822-79a41e45d7ef req-fd97aad3-4bd9-4269-bdcc-228c33cd556e service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:25.441620 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-77450472-fd20-4efd-8822-79a41e45d7ef req-fd97aad3-4bd9-4269-bdcc-228c33cd556e service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:25.454758 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-77450472-fd20-4efd-8822-79a41e45d7ef req-fd97aad3-4bd9-4269-bdcc-228c33cd556e service nova] Creating event network-vif-plugged:61acbadb-ed19-49d1-a43f-0e58327b568a for instance 865edaf1-a2d9-492e-af4c-05e5aecd6cf8 on hv-cinder-85272 Aug 10 11:37:25.459953 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-77450472-fd20-4efd-8822-79a41e45d7ef req-fd97aad3-4bd9-4269-bdcc-228c33cd556e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034813 Aug 10 11:37:25.461557 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 276/550] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:37:25.555385 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-4ba02ec1-06ad-416b-850d-effb7a41a2a1 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] 10.222.0.62 "DELETE /compute/v2.1/servers/259e6936-b56d-40bb-8581-afaff6f88644" status: 204 len: 0 microversion: 2.1 time: 0.358970 Aug 10 11:37:25.556502 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 275/551] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 10 11:37:25 2022] DELETE /compute/v2.1/servers/259e6936-b56d-40bb-8581-afaff6f88644 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 11:37:25.566684 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-89b59415-94c8-4545-9cae-0aef838b83b1 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:25.567628 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-89b59415-94c8-4545-9cae-0aef838b83b1 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 259e6936-b56d-40bb-8581-afaff6f88644] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:25.575016 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-89b59415-94c8-4545-9cae-0aef838b83b1 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:25.575590 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-89b59415-94c8-4545-9cae-0aef838b83b1 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:25.576233 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-89b59415-94c8-4545-9cae-0aef838b83b1 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:25.576939 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-89b59415-94c8-4545-9cae-0aef838b83b1 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:25.577394 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-89b59415-94c8-4545-9cae-0aef838b83b1 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:25.577820 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-89b59415-94c8-4545-9cae-0aef838b83b1 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:25.712113 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-89b59415-94c8-4545-9cae-0aef838b83b1 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d35c64f3a748da9075622e08283aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8329fbf83b104200a04faaa9c454d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:25.720857 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-89b59415-94c8-4545-9cae-0aef838b83b1 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] 10.222.0.62 "GET /compute/v2.1/servers/259e6936-b56d-40bb-8581-afaff6f88644" status: 200 len: 1513 microversion: 2.1 time: 0.158326 Aug 10 11:37:25.721457 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 277/552] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:25 2022] GET /compute/v2.1/servers/259e6936-b56d-40bb-8581-afaff6f88644 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:26.361386 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-49124240-61f7-44f4-a23b-d7bed5a35e85 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:26.362087 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-49124240-61f7-44f4-a23b-d7bed5a35e85 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:26.368425 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-49124240-61f7-44f4-a23b-d7bed5a35e85 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:26.368908 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-49124240-61f7-44f4-a23b-d7bed5a35e85 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:26.369341 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-49124240-61f7-44f4-a23b-d7bed5a35e85 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:26.370023 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-49124240-61f7-44f4-a23b-d7bed5a35e85 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:26.370476 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-49124240-61f7-44f4-a23b-d7bed5a35e85 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:26.370898 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-49124240-61f7-44f4-a23b-d7bed5a35e85 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:26.499558 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-49124240-61f7-44f4-a23b-d7bed5a35e85 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:26.508226 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-49124240-61f7-44f4-a23b-d7bed5a35e85 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:26.509715 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-49124240-61f7-44f4-a23b-d7bed5a35e85 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:26.510797 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-49124240-61f7-44f4-a23b-d7bed5a35e85 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1406 microversion: 2.20 time: 0.153670 Aug 10 11:37:26.511354 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 276/553] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:37:26 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:37:26.743087 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-bfa871b1-07f8-4a42-93ee-638b2c74c47d tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:26.743628 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-bfa871b1-07f8-4a42-93ee-638b2c74c47d tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 259e6936-b56d-40bb-8581-afaff6f88644] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:26.750609 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bfa871b1-07f8-4a42-93ee-638b2c74c47d tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:26.751087 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bfa871b1-07f8-4a42-93ee-638b2c74c47d tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:26.751520 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bfa871b1-07f8-4a42-93ee-638b2c74c47d tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:26.752230 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bfa871b1-07f8-4a42-93ee-638b2c74c47d tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:26.752683 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bfa871b1-07f8-4a42-93ee-638b2c74c47d tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:26.753105 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bfa871b1-07f8-4a42-93ee-638b2c74c47d tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:26.878476 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-bfa871b1-07f8-4a42-93ee-638b2c74c47d tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d35c64f3a748da9075622e08283aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8329fbf83b104200a04faaa9c454d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:26.888910 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-bfa871b1-07f8-4a42-93ee-638b2c74c47d tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] 10.222.0.62 "GET /compute/v2.1/servers/259e6936-b56d-40bb-8581-afaff6f88644" status: 200 len: 1513 microversion: 2.1 time: 0.146626 Aug 10 11:37:26.888910 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 278/554] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:26 2022] GET /compute/v2.1/servers/259e6936-b56d-40bb-8581-afaff6f88644 => generated 1513 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:27.533399 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-8595b195-332d-4a52-811d-7e47b065e4e0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:27.534017 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-8595b195-332d-4a52-811d-7e47b065e4e0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:27.540550 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8595b195-332d-4a52-811d-7e47b065e4e0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:27.541043 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8595b195-332d-4a52-811d-7e47b065e4e0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:27.541484 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8595b195-332d-4a52-811d-7e47b065e4e0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:27.542300 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8595b195-332d-4a52-811d-7e47b065e4e0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:27.542792 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8595b195-332d-4a52-811d-7e47b065e4e0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:27.543807 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8595b195-332d-4a52-811d-7e47b065e4e0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:27.687469 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-e166f6c6-81a2-45bf-b5de-3bec76ac694d tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:27.689826 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-e166f6c6-81a2-45bf-b5de-3bec76ac694d tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:27.695673 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e166f6c6-81a2-45bf-b5de-3bec76ac694d tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:27.696197 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e166f6c6-81a2-45bf-b5de-3bec76ac694d tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:27.696642 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e166f6c6-81a2-45bf-b5de-3bec76ac694d tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:27.697341 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e166f6c6-81a2-45bf-b5de-3bec76ac694d tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:27.697796 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e166f6c6-81a2-45bf-b5de-3bec76ac694d tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:27.698222 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e166f6c6-81a2-45bf-b5de-3bec76ac694d tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:27.727861 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-e166f6c6-81a2-45bf-b5de-3bec76ac694d tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044193 Aug 10 11:37:27.734365 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 279/555] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 10 11:37:27 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 10 11:37:27.780337 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-8595b195-332d-4a52-811d-7e47b065e4e0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:27.780337 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-8595b195-332d-4a52-811d-7e47b065e4e0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:27.781676 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-8595b195-332d-4a52-811d-7e47b065e4e0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:27.782808 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-8595b195-332d-4a52-811d-7e47b065e4e0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1406 microversion: 2.20 time: 0.253519 Aug 10 11:37:27.783362 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 277/556] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:37:27 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1406 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:37:27.797272 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-00a972f9-42d7-4fb3-b009-740a626bf2ab tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:27.797872 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-00a972f9-42d7-4fb3-b009-740a626bf2ab tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:27.803877 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-00a972f9-42d7-4fb3-b009-740a626bf2ab tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:27.804573 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-00a972f9-42d7-4fb3-b009-740a626bf2ab tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:27.805016 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-00a972f9-42d7-4fb3-b009-740a626bf2ab tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:27.805711 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-00a972f9-42d7-4fb3-b009-740a626bf2ab tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:27.806166 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-00a972f9-42d7-4fb3-b009-740a626bf2ab tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:27.806594 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-00a972f9-42d7-4fb3-b009-740a626bf2ab tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:27.833527 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-00a972f9-42d7-4fb3-b009-740a626bf2ab tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Going to try to terminate instance {{(pid=124683) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:37:27.907031 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-adb4326b-42d1-430f-a047-ee011efd0b4f tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:27.907639 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-adb4326b-42d1-430f-a047-ee011efd0b4f tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 259e6936-b56d-40bb-8581-afaff6f88644] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:27.913883 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-adb4326b-42d1-430f-a047-ee011efd0b4f tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:27.914453 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-adb4326b-42d1-430f-a047-ee011efd0b4f tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:27.914986 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-adb4326b-42d1-430f-a047-ee011efd0b4f tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:27.915766 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-adb4326b-42d1-430f-a047-ee011efd0b4f tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:27.916356 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-adb4326b-42d1-430f-a047-ee011efd0b4f tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:27.916880 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-adb4326b-42d1-430f-a047-ee011efd0b4f tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:28.104110 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-00a972f9-42d7-4fb3-b009-740a626bf2ab tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "DELETE /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 204 len: 0 microversion: 2.1 time: 0.310950 Aug 10 11:37:28.104714 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 280/557] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 10 11:37:27 2022] DELETE /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 11:37:28.113960 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-dd057e68-e8fe-4536-9399-9bda0cd781b1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:28.114669 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-dd057e68-e8fe-4536-9399-9bda0cd781b1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:28.120780 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-dd057e68-e8fe-4536-9399-9bda0cd781b1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:28.122032 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-dd057e68-e8fe-4536-9399-9bda0cd781b1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:28.122479 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-dd057e68-e8fe-4536-9399-9bda0cd781b1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:28.123156 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-adb4326b-42d1-430f-a047-ee011efd0b4f tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d35c64f3a748da9075622e08283aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8329fbf83b104200a04faaa9c454d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:28.123322 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-dd057e68-e8fe-4536-9399-9bda0cd781b1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:28.123779 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-dd057e68-e8fe-4536-9399-9bda0cd781b1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:28.124247 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-dd057e68-e8fe-4536-9399-9bda0cd781b1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:28.133756 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-adb4326b-42d1-430f-a047-ee011efd0b4f tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] 10.222.0.62 "GET /compute/v2.1/servers/259e6936-b56d-40bb-8581-afaff6f88644" status: 200 len: 1513 microversion: 2.1 time: 0.230541 Aug 10 11:37:28.134332 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 278/558] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:27 2022] GET /compute/v2.1/servers/259e6936-b56d-40bb-8581-afaff6f88644 => generated 1513 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:28.139530 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-f3c19688-9b87-47d7-bba2-44313a802a4c req-7f186bd4-1ec2-42cd-8515-a1f0d50a4388 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "259e6936-b56d-40bb-8581-afaff6f88644", "name": "network-vif-deleted", "tag": "bd05ca4a-2492-4e02-9e80-88caa8663368"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:37:28.149310 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-f3c19688-9b87-47d7-bba2-44313a802a4c req-7f186bd4-1ec2-42cd-8515-a1f0d50a4388 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:28.149781 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-f3c19688-9b87-47d7-bba2-44313a802a4c req-7f186bd4-1ec2-42cd-8515-a1f0d50a4388 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:28.150236 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-f3c19688-9b87-47d7-bba2-44313a802a4c req-7f186bd4-1ec2-42cd-8515-a1f0d50a4388 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:28.162118 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-f3c19688-9b87-47d7-bba2-44313a802a4c req-7f186bd4-1ec2-42cd-8515-a1f0d50a4388 service nova] Creating event network-vif-deleted:bd05ca4a-2492-4e02-9e80-88caa8663368 for instance 259e6936-b56d-40bb-8581-afaff6f88644 on hv-cinder-85272 Aug 10 11:37:28.167078 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-f3c19688-9b87-47d7-bba2-44313a802a4c req-7f186bd4-1ec2-42cd-8515-a1f0d50a4388 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031663 Aug 10 11:37:28.168662 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 279/559] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:37:28.272592 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-dd057e68-e8fe-4536-9399-9bda0cd781b1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:28.281020 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-dd057e68-e8fe-4536-9399-9bda0cd781b1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1673 microversion: 2.1 time: 0.171349 Aug 10 11:37:28.281592 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 281/560] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:28 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1673 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:37:28.807214 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-3e33eed3-bbb0-4257-b1f5-a6a3b476d8dd tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:28.807908 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-3e33eed3-bbb0-4257-b1f5-a6a3b476d8dd tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:28.814062 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3e33eed3-bbb0-4257-b1f5-a6a3b476d8dd tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:28.814538 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3e33eed3-bbb0-4257-b1f5-a6a3b476d8dd tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:28.814998 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3e33eed3-bbb0-4257-b1f5-a6a3b476d8dd tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:28.815681 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3e33eed3-bbb0-4257-b1f5-a6a3b476d8dd tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:28.816165 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3e33eed3-bbb0-4257-b1f5-a6a3b476d8dd tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:28.816592 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3e33eed3-bbb0-4257-b1f5-a6a3b476d8dd tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:28.947474 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-3e33eed3-bbb0-4257-b1f5-a6a3b476d8dd tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:28.956419 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-3e33eed3-bbb0-4257-b1f5-a6a3b476d8dd tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:28.957902 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-3e33eed3-bbb0-4257-b1f5-a6a3b476d8dd tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:28.958993 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-3e33eed3-bbb0-4257-b1f5-a6a3b476d8dd tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1406 microversion: 2.20 time: 0.156529 Aug 10 11:37:28.959556 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 280/561] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:37:28 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:37:29.156332 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-70c4fa65-cab4-4464-b571-58610e14955c tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:29.156998 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-70c4fa65-cab4-4464-b571-58610e14955c tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 259e6936-b56d-40bb-8581-afaff6f88644] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:29.163275 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-70c4fa65-cab4-4464-b571-58610e14955c tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:29.163756 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-70c4fa65-cab4-4464-b571-58610e14955c tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:29.164224 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-70c4fa65-cab4-4464-b571-58610e14955c tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:29.164912 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-70c4fa65-cab4-4464-b571-58610e14955c tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:29.165365 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-70c4fa65-cab4-4464-b571-58610e14955c tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:29.166225 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-70c4fa65-cab4-4464-b571-58610e14955c tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:29.228229 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-70c4fa65-cab4-4464-b571-58610e14955c tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d35c64f3a748da9075622e08283aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8329fbf83b104200a04faaa9c454d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:29.235585 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-70c4fa65-cab4-4464-b571-58610e14955c tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] 10.222.0.62 "GET /compute/v2.1/servers/259e6936-b56d-40bb-8581-afaff6f88644" status: 200 len: 1471 microversion: 2.1 time: 0.083530 Aug 10 11:37:29.236181 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 282/562] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:29 2022] GET /compute/v2.1/servers/259e6936-b56d-40bb-8581-afaff6f88644 => generated 1471 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:29.301719 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-c8631573-a669-43ba-9e24-b73be24e9fe8 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:29.302335 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-c8631573-a669-43ba-9e24-b73be24e9fe8 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:29.308288 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c8631573-a669-43ba-9e24-b73be24e9fe8 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:29.309399 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c8631573-a669-43ba-9e24-b73be24e9fe8 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:29.310056 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c8631573-a669-43ba-9e24-b73be24e9fe8 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:29.310750 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c8631573-a669-43ba-9e24-b73be24e9fe8 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:29.311211 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c8631573-a669-43ba-9e24-b73be24e9fe8 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:29.311640 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c8631573-a669-43ba-9e24-b73be24e9fe8 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:29.438030 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c8631573-a669-43ba-9e24-b73be24e9fe8 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:29.445431 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-c8631573-a669-43ba-9e24-b73be24e9fe8 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1673 microversion: 2.1 time: 0.147544 Aug 10 11:37:29.445994 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 281/563] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:29 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1673 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:29.982859 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-92eaae01-d18a-4efc-9916-0429c546ea89 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:29.983468 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-92eaae01-d18a-4efc-9916-0429c546ea89 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:29.989534 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-92eaae01-d18a-4efc-9916-0429c546ea89 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:29.990026 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-92eaae01-d18a-4efc-9916-0429c546ea89 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:29.990451 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-92eaae01-d18a-4efc-9916-0429c546ea89 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:29.991133 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-92eaae01-d18a-4efc-9916-0429c546ea89 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:29.991585 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-92eaae01-d18a-4efc-9916-0429c546ea89 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:29.992030 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-92eaae01-d18a-4efc-9916-0429c546ea89 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:30.126846 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-92eaae01-d18a-4efc-9916-0429c546ea89 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:30.134852 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-92eaae01-d18a-4efc-9916-0429c546ea89 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:30.136461 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-92eaae01-d18a-4efc-9916-0429c546ea89 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:30.138310 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-92eaae01-d18a-4efc-9916-0429c546ea89 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1406 microversion: 2.20 time: 0.160279 Aug 10 11:37:30.138866 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 283/564] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:37:29 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:37:30.257057 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-71484e90-d595-4ec3-81f7-3d1677c198c5 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:30.257621 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-71484e90-d595-4ec3-81f7-3d1677c198c5 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 259e6936-b56d-40bb-8581-afaff6f88644] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:30.264811 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-71484e90-d595-4ec3-81f7-3d1677c198c5 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:30.265293 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-71484e90-d595-4ec3-81f7-3d1677c198c5 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:30.265988 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-71484e90-d595-4ec3-81f7-3d1677c198c5 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:30.267326 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-71484e90-d595-4ec3-81f7-3d1677c198c5 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:30.267778 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-71484e90-d595-4ec3-81f7-3d1677c198c5 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:30.268219 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-71484e90-d595-4ec3-81f7-3d1677c198c5 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:30.330015 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-71484e90-d595-4ec3-81f7-3d1677c198c5 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d35c64f3a748da9075622e08283aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8329fbf83b104200a04faaa9c454d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:30.337547 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-71484e90-d595-4ec3-81f7-3d1677c198c5 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] 10.222.0.62 "GET /compute/v2.1/servers/259e6936-b56d-40bb-8581-afaff6f88644" status: 200 len: 1304 microversion: 2.1 time: 0.085268 Aug 10 11:37:30.338105 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 282/565] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:30 2022] GET /compute/v2.1/servers/259e6936-b56d-40bb-8581-afaff6f88644 => generated 1304 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:30.468021 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-cb280d27-3668-4405-95b0-1607850df4e1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:30.468811 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-cb280d27-3668-4405-95b0-1607850df4e1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:30.475274 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cb280d27-3668-4405-95b0-1607850df4e1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:30.475837 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cb280d27-3668-4405-95b0-1607850df4e1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:30.476308 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cb280d27-3668-4405-95b0-1607850df4e1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:30.476987 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cb280d27-3668-4405-95b0-1607850df4e1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:30.477440 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cb280d27-3668-4405-95b0-1607850df4e1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:30.477862 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cb280d27-3668-4405-95b0-1607850df4e1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:30.610705 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-cb280d27-3668-4405-95b0-1607850df4e1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:30.618190 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-cb280d27-3668-4405-95b0-1607850df4e1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1673 microversion: 2.1 time: 0.154636 Aug 10 11:37:30.618756 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 284/566] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:30 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:31.160652 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-d07ab0d5-34b3-4915-9880-cf609908153a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:31.161255 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-d07ab0d5-34b3-4915-9880-cf609908153a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:31.168038 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d07ab0d5-34b3-4915-9880-cf609908153a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:31.168535 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d07ab0d5-34b3-4915-9880-cf609908153a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:31.169058 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d07ab0d5-34b3-4915-9880-cf609908153a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:31.169875 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d07ab0d5-34b3-4915-9880-cf609908153a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:31.170203 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d07ab0d5-34b3-4915-9880-cf609908153a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:31.170624 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d07ab0d5-34b3-4915-9880-cf609908153a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:31.359040 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-3655f0df-f3df-4f59-bd92-c713879888e5 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:31.359690 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-3655f0df-f3df-4f59-bd92-c713879888e5 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] [instance: 259e6936-b56d-40bb-8581-afaff6f88644] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:31.366202 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3655f0df-f3df-4f59-bd92-c713879888e5 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:31.366618 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3655f0df-f3df-4f59-bd92-c713879888e5 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:31.367064 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3655f0df-f3df-4f59-bd92-c713879888e5 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:31.367770 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3655f0df-f3df-4f59-bd92-c713879888e5 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:31.368251 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3655f0df-f3df-4f59-bd92-c713879888e5 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:31.368679 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3655f0df-f3df-4f59-bd92-c713879888e5 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:31.384056 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-3655f0df-f3df-4f59-bd92-c713879888e5 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] HTTP exception thrown: Instance 259e6936-b56d-40bb-8581-afaff6f88644 could not be found. Aug 10 11:37:31.385730 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-3655f0df-f3df-4f59-bd92-c713879888e5 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Request method failure captured: Aug 10 11:37:31.385730 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: request: GET /compute/v2.1/servers/259e6936-b56d-40bb-8581-afaff6f88644 HTTP/1.1 Aug 10 11:37:31.385730 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept: application/json Aug 10 11:37:31.385730 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Aug 10 11:37:31.385730 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Connection: close Aug 10 11:37:31.385730 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Length: 0 Aug 10 11:37:31.385730 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Type: application/json Aug 10 11:37:31.385730 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Host: 10.222.0.62 Aug 10 11:37:31.385730 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Aug 10 11:37:31.385730 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.11 Aug 10 11:37:31.385730 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABi85fpIcS-Eayg2FKbrNWK8Xm0pR4Yq5PX62h2RWu79-D_Nlxzq9hvBVhmVLuZbW1kOjenOakd35zPxQmVBSwFfMHHLpF-_VSKVqiS2lRYA6Li2lt__ZEuiLtsfr5-wN7Y0aFnMyD3Chipn8jSDav1oS8XQLSdSWQ4fG6bxb8mplDpVyE Aug 10 11:37:31.385730 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Aug 10 11:37:31.385730 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Aug 10 11:37:31.385730 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Aug 10 11:37:31.385730 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Aug 10 11:37:31.385730 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Aug 10 11:37:31.385730 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Aug 10 11:37:31.385730 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Id: 8329fbf83b104200a04faaa9c454d708 Aug 10 11:37:31.385730 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-VolumesSnapshotTestJSON-466872305 Aug 10 11:37:31.385730 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Role: member,reader Aug 10 11:37:31.385730 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Aug 10 11:37:31.388217 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/8329fbf83b104200a04faaa9c454d708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_8329fbf83b104200a04faaa9c454d708", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8329fbf83b104200a04faaa9c454d708"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8329fbf83b104200a04faaa9c454d708"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:37:31.388217 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-VolumesSnapshotTestJSON-466872305 Aug 10 11:37:31.388217 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Id: 8329fbf83b104200a04faaa9c454d708 Aug 10 11:37:31.388217 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-466872305 Aug 10 11:37:31.388217 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User: tempest-VolumesSnapshotTestJSON-466872305-project Aug 10 11:37:31.388217 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Aug 10 11:37:31.388217 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Aug 10 11:37:31.388217 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Id: 24d35c64f3a748da9075622e08283aba Aug 10 11:37:31.388217 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-VolumesSnapshotTestJSON-466872305-project Aug 10 11:37:31.388217 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: method: > Aug 10 11:37:31.388217 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: exception: Instance 259e6936-b56d-40bb-8581-afaff6f88644 could not be found. Aug 10 11:37:31.388217 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: action_args: {'id': '259e6936-b56d-40bb-8581-afaff6f88644'} Aug 10 11:37:31.392490 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:37:31.392490 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:37:31.392490 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:37:31.392490 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:37:31.392490 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:37:31.392490 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:37:31.392490 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:37:31.392490 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:37:31.392490 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:37:31.392490 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:37:31.392490 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 259e6936-b56d-40bb-8581-afaff6f88644 could not be found. Aug 10 11:37:31.392490 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:37:31.392490 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:37:31.392490 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:37:31.392490 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:37:31.392490 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:37:31.392490 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:37:31.392490 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:37:31.392490 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:37:31.392490 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:37:31.393718 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:37:31.393718 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:37:31.393718 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:37:31.393718 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:37:31.393718 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:37:31.393718 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:37:31.393718 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:37:31.393718 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 259e6936-b56d-40bb-8581-afaff6f88644 could not be found. Aug 10 11:37:31.393718 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:37:31.393718 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:37:31.393718 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:37:31.393718 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:37:31.393718 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:37:31.393718 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:37:31.393718 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:37:31.393718 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:37:31.393718 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 259e6936-b56d-40bb-8581-afaff6f88644 could not be found. Aug 10 11:37:31.393718 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:37:31.394810 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-3655f0df-f3df-4f59-bd92-c713879888e5 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] Returning 404 to user: Instance 259e6936-b56d-40bb-8581-afaff6f88644 could not be found. {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:37:31.394810 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-3655f0df-f3df-4f59-bd92-c713879888e5 tempest-VolumesSnapshotTestJSON-466872305 tempest-VolumesSnapshotTestJSON-466872305-project] 10.222.0.62 "GET /compute/v2.1/servers/259e6936-b56d-40bb-8581-afaff6f88644" status: 404 len: 111 microversion: 2.1 time: 0.032894 Aug 10 11:37:31.394810 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 285/567] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:31 2022] GET /compute/v2.1/servers/259e6936-b56d-40bb-8581-afaff6f88644 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 11:37:31.559694 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-d07ab0d5-34b3-4915-9880-cf609908153a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:31.567892 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-d07ab0d5-34b3-4915-9880-cf609908153a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:31.569415 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-d07ab0d5-34b3-4915-9880-cf609908153a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:31.570598 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-d07ab0d5-34b3-4915-9880-cf609908153a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1599 microversion: 2.20 time: 0.413905 Aug 10 11:37:31.571165 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 283/568] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:37:31 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1599 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:37:31.593875 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-c4997c6a-cf33-496e-b22a-19ccaef141c6 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:31.594960 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-c4997c6a-cf33-496e-b22a-19ccaef141c6 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:31.603385 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c4997c6a-cf33-496e-b22a-19ccaef141c6 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:31.603385 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c4997c6a-cf33-496e-b22a-19ccaef141c6 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:31.603385 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c4997c6a-cf33-496e-b22a-19ccaef141c6 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:31.603933 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c4997c6a-cf33-496e-b22a-19ccaef141c6 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:31.604477 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c4997c6a-cf33-496e-b22a-19ccaef141c6 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:31.604973 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c4997c6a-cf33-496e-b22a-19ccaef141c6 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:31.639246 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-0a6c1455-638a-4f73-be9b-fe77e162fb61 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:31.639999 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-0a6c1455-638a-4f73-be9b-fe77e162fb61 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:31.646579 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0a6c1455-638a-4f73-be9b-fe77e162fb61 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:31.647078 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0a6c1455-638a-4f73-be9b-fe77e162fb61 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:31.647587 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0a6c1455-638a-4f73-be9b-fe77e162fb61 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:31.648329 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0a6c1455-638a-4f73-be9b-fe77e162fb61 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:31.648954 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0a6c1455-638a-4f73-be9b-fe77e162fb61 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:31.649387 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0a6c1455-638a-4f73-be9b-fe77e162fb61 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:31.725181 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-0a6c1455-638a-4f73-be9b-fe77e162fb61 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:31.733597 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-0a6c1455-638a-4f73-be9b-fe77e162fb61 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1607 microversion: 2.1 time: 0.098674 Aug 10 11:37:31.734173 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 284/569] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:31 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1607 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:37:31.816939 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-c4997c6a-cf33-496e-b22a-19ccaef141c6 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.227438 Aug 10 11:37:31.817528 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 286/570] 10.222.0.62 () {60 vars in 1316 bytes} [Wed Aug 10 11:37:31 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8/os-interface => generated 285 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:37:31.921609 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-7c7b297c-25fb-4fcb-a5cc-b43382690925 req-b1de2892-4f51-4dbd-aac2-01ee472770db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61282604-5de4-413b-be4c-80aadca981b3", "name": "network-vif-deleted", "tag": "6a87af65-add0-4b0b-b0e4-e0ac69cae1fd"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:37:31.945755 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-7c7b297c-25fb-4fcb-a5cc-b43382690925 req-b1de2892-4f51-4dbd-aac2-01ee472770db service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:31.946551 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-7c7b297c-25fb-4fcb-a5cc-b43382690925 req-b1de2892-4f51-4dbd-aac2-01ee472770db service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:31.947055 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-7c7b297c-25fb-4fcb-a5cc-b43382690925 req-b1de2892-4f51-4dbd-aac2-01ee472770db service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:31.993692 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-7c7b297c-25fb-4fcb-a5cc-b43382690925 req-b1de2892-4f51-4dbd-aac2-01ee472770db service nova] Creating event network-vif-deleted:6a87af65-add0-4b0b-b0e4-e0ac69cae1fd for instance 61282604-5de4-413b-be4c-80aadca981b3 on hv-cinder-85272 Aug 10 11:37:32.006969 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-7c7b297c-25fb-4fcb-a5cc-b43382690925 req-b1de2892-4f51-4dbd-aac2-01ee472770db service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096113 Aug 10 11:37:32.008408 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 285/571] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:37:32.755135 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-4812505e-1c5e-4345-8459-02d3a9b6f686 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:32.755796 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-4812505e-1c5e-4345-8459-02d3a9b6f686 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:32.763531 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4812505e-1c5e-4345-8459-02d3a9b6f686 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:32.764095 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4812505e-1c5e-4345-8459-02d3a9b6f686 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:32.764501 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4812505e-1c5e-4345-8459-02d3a9b6f686 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:32.765216 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4812505e-1c5e-4345-8459-02d3a9b6f686 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:32.765938 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4812505e-1c5e-4345-8459-02d3a9b6f686 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:32.766571 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4812505e-1c5e-4345-8459-02d3a9b6f686 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:32.800237 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4812505e-1c5e-4345-8459-02d3a9b6f686 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:32.800452 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4812505e-1c5e-4345-8459-02d3a9b6f686 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:32.800808 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4812505e-1c5e-4345-8459-02d3a9b6f686 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:32.801304 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.objects.instance [None req-4812505e-1c5e-4345-8459-02d3a9b6f686 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lazy-loading 'fault' on Instance uuid 61282604-5de4-413b-be4c-80aadca981b3 {{(pid=124683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:37:32.878806 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-4812505e-1c5e-4345-8459-02d3a9b6f686 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:32.885533 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-4812505e-1c5e-4345-8459-02d3a9b6f686 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 200 len: 1327 microversion: 2.1 time: 0.134648 Aug 10 11:37:32.886352 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 287/572] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:32 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 1327 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:32.945822 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-bcbacb59-ec65-4e84-8e63-1d70cbef6630 req-3629effa-553d-48e6-b9bf-72b82b609019 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "865edaf1-a2d9-492e-af4c-05e5aecd6cf8", "tag": "61acbadb-ed19-49d1-a43f-0e58327b568a"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:37:32.960567 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-bcbacb59-ec65-4e84-8e63-1d70cbef6630 req-3629effa-553d-48e6-b9bf-72b82b609019 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:32.961309 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-bcbacb59-ec65-4e84-8e63-1d70cbef6630 req-3629effa-553d-48e6-b9bf-72b82b609019 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:32.961897 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-bcbacb59-ec65-4e84-8e63-1d70cbef6630 req-3629effa-553d-48e6-b9bf-72b82b609019 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:32.984936 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-bcbacb59-ec65-4e84-8e63-1d70cbef6630 req-3629effa-553d-48e6-b9bf-72b82b609019 service nova] Creating event network-changed:61acbadb-ed19-49d1-a43f-0e58327b568a for instance 865edaf1-a2d9-492e-af4c-05e5aecd6cf8 on hv-cinder-85272 Aug 10 11:37:32.998344 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-bcbacb59-ec65-4e84-8e63-1d70cbef6630 req-3629effa-553d-48e6-b9bf-72b82b609019 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057878 Aug 10 11:37:33.006089 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 286/573] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:37:33.907253 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-900324eb-1ad8-4fe2-ab3c-144748837292 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:33.907859 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-900324eb-1ad8-4fe2-ab3c-144748837292 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:33.914331 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-900324eb-1ad8-4fe2-ab3c-144748837292 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:33.914807 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-900324eb-1ad8-4fe2-ab3c-144748837292 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:33.915241 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-900324eb-1ad8-4fe2-ab3c-144748837292 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:33.915915 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-900324eb-1ad8-4fe2-ab3c-144748837292 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:33.916392 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-900324eb-1ad8-4fe2-ab3c-144748837292 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:33.916813 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-900324eb-1ad8-4fe2-ab3c-144748837292 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:33.930935 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-900324eb-1ad8-4fe2-ab3c-144748837292 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] HTTP exception thrown: Instance 61282604-5de4-413b-be4c-80aadca981b3 could not be found. Aug 10 11:37:33.932616 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-900324eb-1ad8-4fe2-ab3c-144748837292 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Request method failure captured: Aug 10 11:37:33.932616 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: request: GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 HTTP/1.1 Aug 10 11:37:33.932616 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept: application/json Aug 10 11:37:33.932616 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Aug 10 11:37:33.932616 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Connection: close Aug 10 11:37:33.932616 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Length: 0 Aug 10 11:37:33.932616 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Type: application/json Aug 10 11:37:33.932616 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Host: 10.222.0.62 Aug 10 11:37:33.932616 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Aug 10 11:37:33.932616 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.11 Aug 10 11:37:33.932616 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABi85dfIpriryLbB59GELPFg4XM5K1wh_3EUPq0KMWNK2G4JDFL74K5NjEJKks5wfyj8ACGp3JhfD-7BS8lBdkX3qlM8v99bkHvzzzR-2qPhECz_z7426PKHOsTP8ypAQtnaQfBZprrSi9ZvF3u7dpLOpLd6-8hSvMhHuKJ0XIbTku4vfA Aug 10 11:37:33.932616 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Aug 10 11:37:33.932616 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Aug 10 11:37:33.932616 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Aug 10 11:37:33.932616 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Aug 10 11:37:33.932616 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Aug 10 11:37:33.932616 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Aug 10 11:37:33.932616 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Id: 1aad65fe5d6c49bfad958684f6a79c22 Aug 10 11:37:33.932616 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-AttachVolumeTestJSON-214789268 Aug 10 11:37:33.932616 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Role: member,reader Aug 10 11:37:33.932616 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Aug 10 11:37:33.934374 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1aad65fe5d6c49bfad958684f6a79c22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1aad65fe5d6c49bfad958684f6a79c22", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1aad65fe5d6c49bfad958684f6a79c22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1aad65fe5d6c49bfad958684f6a79c22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:37:33.934374 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-AttachVolumeTestJSON-214789268 Aug 10 11:37:33.934374 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Id: 1aad65fe5d6c49bfad958684f6a79c22 Aug 10 11:37:33.934374 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-AttachVolumeTestJSON-214789268 Aug 10 11:37:33.934374 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User: tempest-AttachVolumeTestJSON-214789268-project Aug 10 11:37:33.934374 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Aug 10 11:37:33.934374 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Aug 10 11:37:33.934374 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Id: 2a528c05e8294590a0b9c1227593276f Aug 10 11:37:33.934374 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-AttachVolumeTestJSON-214789268-project Aug 10 11:37:33.934374 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: method: > Aug 10 11:37:33.934374 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: exception: Instance 61282604-5de4-413b-be4c-80aadca981b3 could not be found. Aug 10 11:37:33.934374 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: action_args: {'id': '61282604-5de4-413b-be4c-80aadca981b3'} Aug 10 11:37:33.937871 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:37:33.937871 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:37:33.937871 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:37:33.937871 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:37:33.937871 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:37:33.937871 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:37:33.937871 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:37:33.937871 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:37:33.937871 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:37:33.937871 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:37:33.937871 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61282604-5de4-413b-be4c-80aadca981b3 could not be found. Aug 10 11:37:33.937871 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:37:33.937871 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:37:33.937871 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:37:33.937871 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:37:33.937871 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:37:33.937871 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:37:33.937871 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:37:33.937871 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:37:33.937871 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:37:33.939205 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:37:33.939205 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:37:33.939205 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:37:33.939205 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:37:33.939205 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:37:33.939205 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:37:33.939205 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:37:33.939205 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61282604-5de4-413b-be4c-80aadca981b3 could not be found. Aug 10 11:37:33.939205 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:37:33.939205 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:37:33.939205 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:37:33.939205 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:37:33.939205 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:37:33.939205 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:37:33.939205 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:37:33.939205 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:37:33.939205 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61282604-5de4-413b-be4c-80aadca981b3 could not be found. Aug 10 11:37:33.939205 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:37:33.940486 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-900324eb-1ad8-4fe2-ab3c-144748837292 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Returning 404 to user: Instance 61282604-5de4-413b-be4c-80aadca981b3 could not be found. {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:37:33.940486 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-900324eb-1ad8-4fe2-ab3c-144748837292 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 404 len: 111 microversion: 2.1 time: 0.030635 Aug 10 11:37:33.940486 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 288/574] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:33 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:37:33.943445 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-ff900a81-c0c2-417e-8e50-64536e5d6f69 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '.version_select at 0x7fb7ce601820>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:34.031422 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-ff900a81-c0c2-417e-8e50-64536e5d6f69 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-353850793" status: 202 len: 0 microversion: 2.1 time: 0.091981 Aug 10 11:37:34.035365 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 287/575] 10.222.0.62 () {58 vars in 1218 bytes} [Wed Aug 10 11:37:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-353850793 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:37:34.804897 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-9e86321d-1f19-4303-aeea-ca3a090f6aab tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Action: 'create', calling method: .version_select at 0x7fb7cdc8db80>, body: {"keypair": {"name": "tempest-keypair-518138461", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLK9BbZ7s8x5T9Jt4qMfjfM+3Scth/DBpu1ipYGT1mHttzUh2Bc6Nkau9BVQ1BxVx+fGzZcsJZMk/6KsmustL87JhMYEu75o+4bjx/s0uYlMHrFy9RNj8FwAKd2MC8TusA=="}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:37:34.820367 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-9e86321d-1f19-4303-aeea-ca3a090f6aab tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Getting quotas for project 1aad65fe5d6c49bfad958684f6a79c22. Resources: {'key_pairs'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:37:34.824784 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-9e86321d-1f19-4303-aeea-ca3a090f6aab tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Getting quotas for user 2a528c05e8294590a0b9c1227593276f and project 1aad65fe5d6c49bfad958684f6a79c22. Resources: {'key_pairs'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:37:34.876139 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-9e86321d-1f19-4303-aeea-ca3a090f6aab tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.075050 Aug 10 11:37:34.876782 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 289/576] 10.222.0.62 () {60 vars in 1159 bytes} [Wed Aug 10 11:37:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:37:36.983937 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-e9dcebe8-90e6-4a41-a163-d5c00675fe24 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-870507989", "imageRef": "99bbc441-5102-4a51-a496-cfbffeb3033a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5775eed8-b840-4741-8a0a-1ab22fd30792"}], "security_groups": [{"name": "tempest-securitygroup--1639162891"}], "key_name": "tempest-keypair-518138461", "user_data": "}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:37:37.189437 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.network.neutron [None req-e9dcebe8-90e6-4a41-a163-d5c00675fe24 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] validate_networks() for [('5775eed8-b840-4741-8a0a-1ab22fd30792', None, None, None, None, None)] {{(pid=124682) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:37:37.550156 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-e9dcebe8-90e6-4a41-a163-d5c00675fe24 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Flavor limits 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:37:37.550581 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-e9dcebe8-90e6-4a41-a163-d5c00675fe24 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Image limits 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:37:37.551057 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-e9dcebe8-90e6-4a41-a163-d5c00675fe24 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Flavor pref 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:37:37.551463 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-e9dcebe8-90e6-4a41-a163-d5c00675fe24 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Image pref 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:37:37.551871 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-e9dcebe8-90e6-4a41-a163-d5c00675fe24 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:37:37.561232 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e9dcebe8-90e6-4a41-a163-d5c00675fe24 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:37.561717 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e9dcebe8-90e6-4a41-a163-d5c00675fe24 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:37.562151 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e9dcebe8-90e6-4a41-a163-d5c00675fe24 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:37.562873 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e9dcebe8-90e6-4a41-a163-d5c00675fe24 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:37.563525 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e9dcebe8-90e6-4a41-a163-d5c00675fe24 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:37.563991 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e9dcebe8-90e6-4a41-a163-d5c00675fe24 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:37.582382 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-e9dcebe8-90e6-4a41-a163-d5c00675fe24 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Getting quotas for project 1aad65fe5d6c49bfad958684f6a79c22. Resources: {'ram', 'instances', 'cores'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:37:37.586466 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-e9dcebe8-90e6-4a41-a163-d5c00675fe24 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Getting quotas for user 2a528c05e8294590a0b9c1227593276f and project 1aad65fe5d6c49bfad958684f6a79c22. Resources: {'ram', 'instances', 'cores'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:37:37.597820 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-e9dcebe8-90e6-4a41-a163-d5c00675fe24 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Going to run 1 instances... {{(pid=124682) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:37:37.600228 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-e9dcebe8-90e6-4a41-a163-d5c00675fe24 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: ae770112-a153-4fc8-97ea-637cd10d7024] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99bbc441-5102-4a51-a496-cfbffeb3033a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:37:37.716858 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-e9dcebe8-90e6-4a41-a163-d5c00675fe24 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.738298 Aug 10 11:37:37.717682 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 288/577] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Aug 10 11:37:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 11:37:37.728655 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-c453fd8f-778b-432b-811b-57531c624bdd tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:37.729288 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-c453fd8f-778b-432b-811b-57531c624bdd tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: ae770112-a153-4fc8-97ea-637cd10d7024] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:37.785185 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-c453fd8f-778b-432b-811b-57531c624bdd tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:37.792450 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-c453fd8f-778b-432b-811b-57531c624bdd tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024" status: 200 len: 1236 microversion: 2.1 time: 0.068028 Aug 10 11:37:37.793014 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 290/578] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:37 2022] GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024 => generated 1236 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:38.814041 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-ad0fc3d2-1373-4c23-881e-410790ea865c tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:38.814654 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-ad0fc3d2-1373-4c23-881e-410790ea865c tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: ae770112-a153-4fc8-97ea-637cd10d7024] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:38.821839 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ad0fc3d2-1373-4c23-881e-410790ea865c tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:38.822326 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ad0fc3d2-1373-4c23-881e-410790ea865c tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:38.822767 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ad0fc3d2-1373-4c23-881e-410790ea865c tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:38.823462 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ad0fc3d2-1373-4c23-881e-410790ea865c tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:38.823913 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ad0fc3d2-1373-4c23-881e-410790ea865c tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:38.824365 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ad0fc3d2-1373-4c23-881e-410790ea865c tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:38.889637 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-ad0fc3d2-1373-4c23-881e-410790ea865c tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:38.898374 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-ad0fc3d2-1373-4c23-881e-410790ea865c tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024" status: 200 len: 1240 microversion: 2.1 time: 0.089333 Aug 10 11:37:38.899111 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 289/579] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:38 2022] GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024 => generated 1240 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:39.256970 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-6ad41e9b-2de6-4b0d-b109-454bfb92a85f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:39.257469 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-6ad41e9b-2de6-4b0d-b109-454bfb92a85f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:39.266690 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6ad41e9b-2de6-4b0d-b109-454bfb92a85f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:39.267416 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6ad41e9b-2de6-4b0d-b109-454bfb92a85f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:39.268147 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6ad41e9b-2de6-4b0d-b109-454bfb92a85f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:39.269101 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6ad41e9b-2de6-4b0d-b109-454bfb92a85f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:39.269558 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6ad41e9b-2de6-4b0d-b109-454bfb92a85f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:39.269977 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6ad41e9b-2de6-4b0d-b109-454bfb92a85f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:39.358752 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.objects.instance [None req-6ad41e9b-2de6-4b0d-b109-454bfb92a85f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lazy-loading 'services' on Instance uuid f70dab9f-931f-4e70-bb09-0a053d3220a5 {{(pid=124683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:37:39.577145 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-6ad41e9b-2de6-4b0d-b109-454bfb92a85f tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "DELETE /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5/os-volume_attachments/5b892eb7-3331-4840-a16d-f1f7d17913eb" status: 202 len: 0 microversion: 2.1 time: 0.326076 Aug 10 11:37:39.577750 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 291/580] 10.222.0.62 () {58 vars in 1416 bytes} [Wed Aug 10 11:37:39 2022] DELETE /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5/os-volume_attachments/5b892eb7-3331-4840-a16d-f1f7d17913eb => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:37:39.586698 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-aa3b3648-a840-4e7c-816c-94be085cb402 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:39.588985 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-aa3b3648-a840-4e7c-816c-94be085cb402 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:39.596146 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-aa3b3648-a840-4e7c-816c-94be085cb402 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:39.596628 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-aa3b3648-a840-4e7c-816c-94be085cb402 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:39.597063 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-aa3b3648-a840-4e7c-816c-94be085cb402 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:39.597782 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-aa3b3648-a840-4e7c-816c-94be085cb402 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:39.598228 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-aa3b3648-a840-4e7c-816c-94be085cb402 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:39.598647 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-aa3b3648-a840-4e7c-816c-94be085cb402 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:39.633781 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-aa3b3648-a840-4e7c-816c-94be085cb402 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051257 Aug 10 11:37:39.634339 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 290/581] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 10 11:37:39 2022] GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:37:39.922488 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-a0d9d313-5423-4dc0-9026-91546fac2473 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:39.923484 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-a0d9d313-5423-4dc0-9026-91546fac2473 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: ae770112-a153-4fc8-97ea-637cd10d7024] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:39.929985 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a0d9d313-5423-4dc0-9026-91546fac2473 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:39.930459 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a0d9d313-5423-4dc0-9026-91546fac2473 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:39.930889 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a0d9d313-5423-4dc0-9026-91546fac2473 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:39.931571 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a0d9d313-5423-4dc0-9026-91546fac2473 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:39.932043 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a0d9d313-5423-4dc0-9026-91546fac2473 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:39.932463 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a0d9d313-5423-4dc0-9026-91546fac2473 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:39.996349 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-a0d9d313-5423-4dc0-9026-91546fac2473 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:40.004296 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-a0d9d313-5423-4dc0-9026-91546fac2473 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024" status: 200 len: 1296 microversion: 2.1 time: 0.087502 Aug 10 11:37:40.004878 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 292/582] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:39 2022] GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024 => generated 1296 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:40.649126 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-be8eea10-b9dc-4509-9e67-0d4416086cb9 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:40.662337 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-be8eea10-b9dc-4509-9e67-0d4416086cb9 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:40.662337 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-be8eea10-b9dc-4509-9e67-0d4416086cb9 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:40.662337 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-be8eea10-b9dc-4509-9e67-0d4416086cb9 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:40.663219 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-be8eea10-b9dc-4509-9e67-0d4416086cb9 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:40.663954 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-be8eea10-b9dc-4509-9e67-0d4416086cb9 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:40.664439 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-be8eea10-b9dc-4509-9e67-0d4416086cb9 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:40.665201 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-be8eea10-b9dc-4509-9e67-0d4416086cb9 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:40.696392 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:37:40.701225 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-be8eea10-b9dc-4509-9e67-0d4416086cb9 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058093 Aug 10 11:37:40.703691 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 291/583] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 10 11:37:40 2022] GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 11:37:40.792499 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-0d5b7d3b-82c1-4b96-a59a-40b09f75a5f0 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:40.793050 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-0d5b7d3b-82c1-4b96-a59a-40b09f75a5f0 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:40.799807 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0d5b7d3b-82c1-4b96-a59a-40b09f75a5f0 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:40.800332 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0d5b7d3b-82c1-4b96-a59a-40b09f75a5f0 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:40.800770 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0d5b7d3b-82c1-4b96-a59a-40b09f75a5f0 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:40.801601 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0d5b7d3b-82c1-4b96-a59a-40b09f75a5f0 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:40.802077 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0d5b7d3b-82c1-4b96-a59a-40b09f75a5f0 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:40.802484 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0d5b7d3b-82c1-4b96-a59a-40b09f75a5f0 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:40.806822 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=96,nova_cell1:UPDATE=1 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:37:40.829832 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-0d5b7d3b-82c1-4b96-a59a-40b09f75a5f0 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Going to try to terminate instance {{(pid=124683) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:37:41.028782 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-6e08d01c-6d9a-48b8-ace4-98367a4abfcc tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:41.034076 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-6e08d01c-6d9a-48b8-ace4-98367a4abfcc tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: ae770112-a153-4fc8-97ea-637cd10d7024] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:41.051131 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6e08d01c-6d9a-48b8-ace4-98367a4abfcc tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:41.052073 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6e08d01c-6d9a-48b8-ace4-98367a4abfcc tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:41.052612 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6e08d01c-6d9a-48b8-ace4-98367a4abfcc tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:41.053955 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6e08d01c-6d9a-48b8-ace4-98367a4abfcc tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:41.054504 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6e08d01c-6d9a-48b8-ace4-98367a4abfcc tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:41.055188 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6e08d01c-6d9a-48b8-ace4-98367a4abfcc tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:41.167537 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-0d5b7d3b-82c1-4b96-a59a-40b09f75a5f0 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "DELETE /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5" status: 204 len: 0 microversion: 2.1 time: 0.378423 Aug 10 11:37:41.169817 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 293/584] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 10 11:37:40 2022] DELETE /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:37:41.188049 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-e439ac89-e29b-43e6-8fd5-fb966beccfd3 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:41.194302 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-e439ac89-e29b-43e6-8fd5-fb966beccfd3 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:41.205132 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e439ac89-e29b-43e6-8fd5-fb966beccfd3 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:41.205888 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e439ac89-e29b-43e6-8fd5-fb966beccfd3 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:41.206613 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e439ac89-e29b-43e6-8fd5-fb966beccfd3 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:41.207844 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e439ac89-e29b-43e6-8fd5-fb966beccfd3 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:41.208506 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e439ac89-e29b-43e6-8fd5-fb966beccfd3 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:41.209099 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e439ac89-e29b-43e6-8fd5-fb966beccfd3 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:41.376462 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-e439ac89-e29b-43e6-8fd5-fb966beccfd3 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:41.384043 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-e439ac89-e29b-43e6-8fd5-fb966beccfd3 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5" status: 200 len: 1688 microversion: 2.1 time: 0.205434 Aug 10 11:37:41.384827 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 294/585] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:41 2022] GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5 => generated 1688 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:41.409454 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-6e08d01c-6d9a-48b8-ace4-98367a4abfcc tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:41.417344 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-6e08d01c-6d9a-48b8-ace4-98367a4abfcc tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024" status: 200 len: 1362 microversion: 2.1 time: 0.394213 Aug 10 11:37:41.417922 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 292/586] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:41 2022] GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024 => generated 1362 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:41.977611 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-71c6d155-e555-4629-8bf1-c64ad719c05b req-d7c0f046-dac9-4265-9aec-51bfdd997c86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae770112-a153-4fc8-97ea-637cd10d7024", "tag": "c38a855d-5851-489c-ad2f-d32c8362217b"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:37:41.988277 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-71c6d155-e555-4629-8bf1-c64ad719c05b req-d7c0f046-dac9-4265-9aec-51bfdd997c86 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:41.988760 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-71c6d155-e555-4629-8bf1-c64ad719c05b req-d7c0f046-dac9-4265-9aec-51bfdd997c86 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:41.989200 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-71c6d155-e555-4629-8bf1-c64ad719c05b req-d7c0f046-dac9-4265-9aec-51bfdd997c86 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:42.000277 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-71c6d155-e555-4629-8bf1-c64ad719c05b req-d7c0f046-dac9-4265-9aec-51bfdd997c86 service nova] Creating event network-changed:c38a855d-5851-489c-ad2f-d32c8362217b for instance ae770112-a153-4fc8-97ea-637cd10d7024 on hv-cinder-85272 Aug 10 11:37:42.005131 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-71c6d155-e555-4629-8bf1-c64ad719c05b req-d7c0f046-dac9-4265-9aec-51bfdd997c86 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031437 Aug 10 11:37:42.005742 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 295/587] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:37:42.407394 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-8edbf54d-ce22-47d8-9e43-818bbc771f22 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:42.407929 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-8edbf54d-ce22-47d8-9e43-818bbc771f22 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:42.414408 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8edbf54d-ce22-47d8-9e43-818bbc771f22 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:42.414926 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8edbf54d-ce22-47d8-9e43-818bbc771f22 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:42.415365 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8edbf54d-ce22-47d8-9e43-818bbc771f22 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:42.416074 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8edbf54d-ce22-47d8-9e43-818bbc771f22 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:42.416527 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8edbf54d-ce22-47d8-9e43-818bbc771f22 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:42.416948 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8edbf54d-ce22-47d8-9e43-818bbc771f22 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:42.440949 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-47c16c8f-0a94-4b78-9225-489bf48deb4e tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:42.441654 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-47c16c8f-0a94-4b78-9225-489bf48deb4e tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: ae770112-a153-4fc8-97ea-637cd10d7024] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:42.447672 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-47c16c8f-0a94-4b78-9225-489bf48deb4e tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:42.448203 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-47c16c8f-0a94-4b78-9225-489bf48deb4e tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:42.448639 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-47c16c8f-0a94-4b78-9225-489bf48deb4e tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:42.449339 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-47c16c8f-0a94-4b78-9225-489bf48deb4e tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:42.449828 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-47c16c8f-0a94-4b78-9225-489bf48deb4e tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:42.450360 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-47c16c8f-0a94-4b78-9225-489bf48deb4e tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:42.557446 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-8edbf54d-ce22-47d8-9e43-818bbc771f22 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:42.572818 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-8edbf54d-ce22-47d8-9e43-818bbc771f22 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5" status: 200 len: 1688 microversion: 2.1 time: 0.163679 Aug 10 11:37:42.572818 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 293/588] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:42 2022] GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5 => generated 1688 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:42.593865 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-47c16c8f-0a94-4b78-9225-489bf48deb4e tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:42.603480 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-47c16c8f-0a94-4b78-9225-489bf48deb4e tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024" status: 200 len: 1362 microversion: 2.1 time: 0.166611 Aug 10 11:37:42.604178 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 296/589] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:42 2022] GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:37:43.588341 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-824e1c01-401b-4347-80d5-7097af43cd73 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:43.588968 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-824e1c01-401b-4347-80d5-7097af43cd73 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:43.595783 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-824e1c01-401b-4347-80d5-7097af43cd73 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:43.596295 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-824e1c01-401b-4347-80d5-7097af43cd73 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:43.596731 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-824e1c01-401b-4347-80d5-7097af43cd73 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:43.597409 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-824e1c01-401b-4347-80d5-7097af43cd73 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:43.597864 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-824e1c01-401b-4347-80d5-7097af43cd73 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:43.598287 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-824e1c01-401b-4347-80d5-7097af43cd73 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:43.625910 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-3a31077f-0941-4f26-8e18-859cbd245ed4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:43.626793 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-3a31077f-0941-4f26-8e18-859cbd245ed4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: ae770112-a153-4fc8-97ea-637cd10d7024] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:43.633278 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3a31077f-0941-4f26-8e18-859cbd245ed4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:43.633773 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3a31077f-0941-4f26-8e18-859cbd245ed4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:43.634214 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3a31077f-0941-4f26-8e18-859cbd245ed4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:43.634914 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3a31077f-0941-4f26-8e18-859cbd245ed4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:43.635370 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3a31077f-0941-4f26-8e18-859cbd245ed4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:43.635998 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3a31077f-0941-4f26-8e18-859cbd245ed4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:43.730668 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-824e1c01-401b-4347-80d5-7097af43cd73 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:43.739280 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-824e1c01-401b-4347-80d5-7097af43cd73 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5" status: 200 len: 1688 microversion: 2.1 time: 0.154861 Aug 10 11:37:43.739859 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 294/590] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:43 2022] GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5 => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:43.766705 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-3a31077f-0941-4f26-8e18-859cbd245ed4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:43.774067 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-3a31077f-0941-4f26-8e18-859cbd245ed4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024" status: 200 len: 1362 microversion: 2.1 time: 0.152820 Aug 10 11:37:43.774633 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 297/591] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:43 2022] GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:37:44.760901 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-ffd4eaae-785a-4726-9fe3-e0a663803c55 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:44.761522 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-ffd4eaae-785a-4726-9fe3-e0a663803c55 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:44.768220 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ffd4eaae-785a-4726-9fe3-e0a663803c55 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:44.768707 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ffd4eaae-785a-4726-9fe3-e0a663803c55 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:44.769152 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ffd4eaae-785a-4726-9fe3-e0a663803c55 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:44.769841 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ffd4eaae-785a-4726-9fe3-e0a663803c55 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:44.770298 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ffd4eaae-785a-4726-9fe3-e0a663803c55 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:44.770759 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ffd4eaae-785a-4726-9fe3-e0a663803c55 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:44.794989 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-8495299d-e04b-4398-b5c0-ac7cf47c2169 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:44.795602 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-8495299d-e04b-4398-b5c0-ac7cf47c2169 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: ae770112-a153-4fc8-97ea-637cd10d7024] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:44.801868 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8495299d-e04b-4398-b5c0-ac7cf47c2169 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:44.802363 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8495299d-e04b-4398-b5c0-ac7cf47c2169 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:44.802807 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8495299d-e04b-4398-b5c0-ac7cf47c2169 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:44.803503 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8495299d-e04b-4398-b5c0-ac7cf47c2169 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:44.803980 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8495299d-e04b-4398-b5c0-ac7cf47c2169 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:44.804413 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8495299d-e04b-4398-b5c0-ac7cf47c2169 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:44.900516 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-ffd4eaae-785a-4726-9fe3-e0a663803c55 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:44.908586 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-ffd4eaae-785a-4726-9fe3-e0a663803c55 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5" status: 200 len: 1688 microversion: 2.1 time: 0.151546 Aug 10 11:37:44.909092 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 295/592] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:44 2022] GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5 => generated 1688 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:44.936379 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-8495299d-e04b-4398-b5c0-ac7cf47c2169 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:44.943705 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-8495299d-e04b-4398-b5c0-ac7cf47c2169 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024" status: 200 len: 1362 microversion: 2.1 time: 0.153121 Aug 10 11:37:44.944305 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 298/593] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:44 2022] GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:37:45.930635 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-659e5303-7acd-4e71-9150-fb1188bedfbb tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:45.931242 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-659e5303-7acd-4e71-9150-fb1188bedfbb tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:45.937901 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-659e5303-7acd-4e71-9150-fb1188bedfbb tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:45.938325 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-659e5303-7acd-4e71-9150-fb1188bedfbb tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:45.938899 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-659e5303-7acd-4e71-9150-fb1188bedfbb tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:45.939588 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-659e5303-7acd-4e71-9150-fb1188bedfbb tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:45.940067 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-659e5303-7acd-4e71-9150-fb1188bedfbb tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:45.940495 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-659e5303-7acd-4e71-9150-fb1188bedfbb tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:45.963744 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-b19d7f8a-8124-4117-9159-fd66fdd55738 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:45.964377 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-b19d7f8a-8124-4117-9159-fd66fdd55738 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: ae770112-a153-4fc8-97ea-637cd10d7024] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:45.971583 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b19d7f8a-8124-4117-9159-fd66fdd55738 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:45.972100 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b19d7f8a-8124-4117-9159-fd66fdd55738 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:45.972557 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b19d7f8a-8124-4117-9159-fd66fdd55738 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:45.973246 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b19d7f8a-8124-4117-9159-fd66fdd55738 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:45.973696 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b19d7f8a-8124-4117-9159-fd66fdd55738 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:45.974120 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b19d7f8a-8124-4117-9159-fd66fdd55738 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:46.117530 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-b19d7f8a-8124-4117-9159-fd66fdd55738 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:46.125747 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-b19d7f8a-8124-4117-9159-fd66fdd55738 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024" status: 200 len: 1362 microversion: 2.1 time: 0.165774 Aug 10 11:37:46.128247 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 299/594] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:45 2022] GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:37:46.141038 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-659e5303-7acd-4e71-9150-fb1188bedfbb tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:46.148575 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-659e5303-7acd-4e71-9150-fb1188bedfbb tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5" status: 200 len: 1688 microversion: 2.1 time: 0.221802 Aug 10 11:37:46.149157 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 296/595] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:45 2022] GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5 => generated 1688 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:47.176800 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-195d8782-8c57-422b-b6cb-3c5a9ec32645 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:47.176800 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-195d8782-8c57-422b-b6cb-3c5a9ec32645 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:47.185745 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-195d8782-8c57-422b-b6cb-3c5a9ec32645 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:47.188696 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-195d8782-8c57-422b-b6cb-3c5a9ec32645 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:47.192452 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-195d8782-8c57-422b-b6cb-3c5a9ec32645 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:47.200016 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-195d8782-8c57-422b-b6cb-3c5a9ec32645 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:47.200016 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-195d8782-8c57-422b-b6cb-3c5a9ec32645 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:47.200016 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-195d8782-8c57-422b-b6cb-3c5a9ec32645 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:47.241005 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-9a4ce5b1-e31f-4283-8d09-ca21354b52af tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:47.242192 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-9a4ce5b1-e31f-4283-8d09-ca21354b52af tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: ae770112-a153-4fc8-97ea-637cd10d7024] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:47.259554 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9a4ce5b1-e31f-4283-8d09-ca21354b52af tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:47.260076 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9a4ce5b1-e31f-4283-8d09-ca21354b52af tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:47.260710 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9a4ce5b1-e31f-4283-8d09-ca21354b52af tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:47.261433 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9a4ce5b1-e31f-4283-8d09-ca21354b52af tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:47.261895 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9a4ce5b1-e31f-4283-8d09-ca21354b52af tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:47.262326 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9a4ce5b1-e31f-4283-8d09-ca21354b52af tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:47.281682 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-195d8782-8c57-422b-b6cb-3c5a9ec32645 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:47.290346 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-195d8782-8c57-422b-b6cb-3c5a9ec32645 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5" status: 200 len: 1621 microversion: 2.1 time: 0.118790 Aug 10 11:37:47.290940 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 297/596] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:47 2022] GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5 => generated 1621 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:37:47.642976 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-9a4ce5b1-e31f-4283-8d09-ca21354b52af tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:47.650538 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-9a4ce5b1-e31f-4283-8d09-ca21354b52af tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024" status: 200 len: 1362 microversion: 2.1 time: 0.506491 Aug 10 11:37:47.651106 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 300/597] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:47 2022] GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024 => generated 1362 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:37:47.793548 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-7b12f2aa-cf6d-4613-a157-6e3a86762efb req-4952f75f-7928-48fe-a4f4-27a30761cb3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f70dab9f-931f-4e70-bb09-0a053d3220a5", "name": "network-vif-deleted", "tag": "53b710b6-9aea-4621-bdee-7da9637f2bfd"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:37:47.798980 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=2 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:37:47.799744 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=6 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:37:47.805735 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-7b12f2aa-cf6d-4613-a157-6e3a86762efb req-4952f75f-7928-48fe-a4f4-27a30761cb3d service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:47.806220 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-7b12f2aa-cf6d-4613-a157-6e3a86762efb req-4952f75f-7928-48fe-a4f4-27a30761cb3d service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:47.806653 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-7b12f2aa-cf6d-4613-a157-6e3a86762efb req-4952f75f-7928-48fe-a4f4-27a30761cb3d service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:47.818985 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-7b12f2aa-cf6d-4613-a157-6e3a86762efb req-4952f75f-7928-48fe-a4f4-27a30761cb3d service nova] Creating event network-vif-deleted:53b710b6-9aea-4621-bdee-7da9637f2bfd for instance f70dab9f-931f-4e70-bb09-0a053d3220a5 on hv-cinder-85272 Aug 10 11:37:47.824486 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-7b12f2aa-cf6d-4613-a157-6e3a86762efb req-4952f75f-7928-48fe-a4f4-27a30761cb3d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034695 Aug 10 11:37:47.826177 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 298/598] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:37:48.312565 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-083d713c-6f47-4ff2-b1af-c2bb4fe1b702 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:48.313186 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-083d713c-6f47-4ff2-b1af-c2bb4fe1b702 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:48.315159 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=6 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:37:48.320750 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-083d713c-6f47-4ff2-b1af-c2bb4fe1b702 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:48.321243 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-083d713c-6f47-4ff2-b1af-c2bb4fe1b702 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:48.321681 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-083d713c-6f47-4ff2-b1af-c2bb4fe1b702 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:48.322384 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-083d713c-6f47-4ff2-b1af-c2bb4fe1b702 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:48.322843 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-083d713c-6f47-4ff2-b1af-c2bb4fe1b702 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:48.323280 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-083d713c-6f47-4ff2-b1af-c2bb4fe1b702 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:48.355105 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-083d713c-6f47-4ff2-b1af-c2bb4fe1b702 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:48.355597 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-083d713c-6f47-4ff2-b1af-c2bb4fe1b702 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:48.356072 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-083d713c-6f47-4ff2-b1af-c2bb4fe1b702 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:48.356528 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.objects.instance [None req-083d713c-6f47-4ff2-b1af-c2bb4fe1b702 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lazy-loading 'fault' on Instance uuid f70dab9f-931f-4e70-bb09-0a053d3220a5 {{(pid=124683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:37:48.399449 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-083d713c-6f47-4ff2-b1af-c2bb4fe1b702 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:48.408382 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-083d713c-6f47-4ff2-b1af-c2bb4fe1b702 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5" status: 200 len: 1334 microversion: 2.1 time: 0.099807 Aug 10 11:37:48.409195 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 301/599] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:48 2022] GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5 => generated 1334 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:48.672944 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-bbd00201-0508-42f5-bb79-7df2d0fcfac0 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:48.673706 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-bbd00201-0508-42f5-bb79-7df2d0fcfac0 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: ae770112-a153-4fc8-97ea-637cd10d7024] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:48.677955 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:37:48.683080 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bbd00201-0508-42f5-bb79-7df2d0fcfac0 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:48.683564 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bbd00201-0508-42f5-bb79-7df2d0fcfac0 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:48.684214 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bbd00201-0508-42f5-bb79-7df2d0fcfac0 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:48.685712 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bbd00201-0508-42f5-bb79-7df2d0fcfac0 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:48.686162 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bbd00201-0508-42f5-bb79-7df2d0fcfac0 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:48.686762 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bbd00201-0508-42f5-bb79-7df2d0fcfac0 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:48.843245 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-bbd00201-0508-42f5-bb79-7df2d0fcfac0 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:48.853190 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-bbd00201-0508-42f5-bb79-7df2d0fcfac0 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024" status: 200 len: 1362 microversion: 2.1 time: 0.185432 Aug 10 11:37:48.853777 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 299/600] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:48 2022] GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024 => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:49.435644 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-918593a7-07d8-4595-838c-17f579515ceb tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:49.436298 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-918593a7-07d8-4595-838c-17f579515ceb tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: f70dab9f-931f-4e70-bb09-0a053d3220a5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:49.438946 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:37:49.443777 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-918593a7-07d8-4595-838c-17f579515ceb tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:49.444289 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-918593a7-07d8-4595-838c-17f579515ceb tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:49.444725 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-918593a7-07d8-4595-838c-17f579515ceb tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:49.445400 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-918593a7-07d8-4595-838c-17f579515ceb tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:49.445850 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-918593a7-07d8-4595-838c-17f579515ceb tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:49.446301 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-918593a7-07d8-4595-838c-17f579515ceb tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:49.460213 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-918593a7-07d8-4595-838c-17f579515ceb tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] HTTP exception thrown: Instance f70dab9f-931f-4e70-bb09-0a053d3220a5 could not be found. Aug 10 11:37:49.461825 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-918593a7-07d8-4595-838c-17f579515ceb tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Request method failure captured: Aug 10 11:37:49.461825 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: request: GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5 HTTP/1.1 Aug 10 11:37:49.461825 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept: application/json Aug 10 11:37:49.461825 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Aug 10 11:37:49.461825 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Connection: close Aug 10 11:37:49.461825 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Length: 0 Aug 10 11:37:49.461825 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Type: application/json Aug 10 11:37:49.461825 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Host: 10.222.0.62 Aug 10 11:37:49.461825 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Aug 10 11:37:49.461825 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.11 Aug 10 11:37:49.461825 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABi85diKAHwXRzd2il03BjBn4GtPc8kISXNr_WlbPfAO6ScxlA2xKRFTXp6lv4Mx70H4OHfMxyACT9qtANdjRUlG0IXG7zsJ6Yh5tFE6PbxXVb6Pm5mIqh7eSEB9wtnuv9htvQ1QMN0TYW9yui41zYItyS58rcQtQxa6iH9KCT_lRB8CpA Aug 10 11:37:49.461825 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Aug 10 11:37:49.461825 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Aug 10 11:37:49.461825 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Aug 10 11:37:49.461825 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Aug 10 11:37:49.461825 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Aug 10 11:37:49.461825 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Aug 10 11:37:49.461825 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Id: a66fd06041084a16b8d5c5b9a9dbea52 Aug 10 11:37:49.461825 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-956924328 Aug 10 11:37:49.461825 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Role: member,reader Aug 10 11:37:49.461825 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Aug 10 11:37:49.463411 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/a66fd06041084a16b8d5c5b9a9dbea52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_a66fd06041084a16b8d5c5b9a9dbea52", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a66fd06041084a16b8d5c5b9a9dbea52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a66fd06041084a16b8d5c5b9a9dbea52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:37:49.463411 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-ServerRescueNegativeTestJSON-956924328 Aug 10 11:37:49.463411 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Id: a66fd06041084a16b8d5c5b9a9dbea52 Aug 10 11:37:49.463411 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-956924328 Aug 10 11:37:49.463411 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User: tempest-ServerRescueNegativeTestJSON-956924328-project Aug 10 11:37:49.463411 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Aug 10 11:37:49.463411 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Aug 10 11:37:49.463411 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Id: 81be34fdd1d741719b317b4fed21636d Aug 10 11:37:49.463411 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-ServerRescueNegativeTestJSON-956924328-project Aug 10 11:37:49.463411 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: method: > Aug 10 11:37:49.463411 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: exception: Instance f70dab9f-931f-4e70-bb09-0a053d3220a5 could not be found. Aug 10 11:37:49.463411 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: action_args: {'id': 'f70dab9f-931f-4e70-bb09-0a053d3220a5'} Aug 10 11:37:49.464368 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:37:49.464368 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:37:49.464368 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:37:49.464368 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:37:49.464368 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:37:49.464368 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:37:49.464368 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:37:49.464368 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:37:49.464368 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:37:49.464368 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:37:49.464368 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f70dab9f-931f-4e70-bb09-0a053d3220a5 could not be found. Aug 10 11:37:49.464368 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:37:49.464368 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:37:49.464368 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:37:49.464368 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:37:49.464368 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:37:49.464368 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:37:49.464368 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:37:49.464368 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:37:49.464368 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:37:49.465870 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:37:49.465870 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:37:49.465870 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:37:49.465870 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:37:49.465870 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:37:49.465870 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:37:49.465870 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:37:49.465870 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f70dab9f-931f-4e70-bb09-0a053d3220a5 could not be found. Aug 10 11:37:49.465870 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:37:49.465870 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:37:49.465870 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:37:49.465870 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:37:49.465870 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:37:49.465870 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:37:49.465870 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:37:49.465870 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:37:49.465870 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f70dab9f-931f-4e70-bb09-0a053d3220a5 could not be found. Aug 10 11:37:49.465870 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:37:49.468030 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-918593a7-07d8-4595-838c-17f579515ceb tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Returning 404 to user: Instance f70dab9f-931f-4e70-bb09-0a053d3220a5 could not be found. {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:37:49.468030 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-918593a7-07d8-4595-838c-17f579515ceb tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5" status: 404 len: 111 microversion: 2.1 time: 0.031361 Aug 10 11:37:49.468030 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 302/601] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:49 2022] GET /compute/v2.1/servers/f70dab9f-931f-4e70-bb09-0a053d3220a5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:37:49.473304 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-2d29b8cb-71bb-42c2-a743-039b01dd5247 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '.version_select at 0x7fb7ce502430>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:49.583712 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-2d29b8cb-71bb-42c2-a743-039b01dd5247 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-991532839" status: 202 len: 0 microversion: 2.1 time: 0.114372 Aug 10 11:37:49.584358 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 300/602] 10.222.0.62 () {58 vars in 1218 bytes} [Wed Aug 10 11:37:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-991532839 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:37:49.875526 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-7aac4af7-8968-4583-9112-c342d4cd59ea tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:49.876535 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-7aac4af7-8968-4583-9112-c342d4cd59ea tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: ae770112-a153-4fc8-97ea-637cd10d7024] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:49.883641 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7aac4af7-8968-4583-9112-c342d4cd59ea tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:49.884438 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7aac4af7-8968-4583-9112-c342d4cd59ea tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:49.885046 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7aac4af7-8968-4583-9112-c342d4cd59ea tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:49.885930 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7aac4af7-8968-4583-9112-c342d4cd59ea tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:49.886721 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7aac4af7-8968-4583-9112-c342d4cd59ea tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:49.887298 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7aac4af7-8968-4583-9112-c342d4cd59ea tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:50.061212 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-7aac4af7-8968-4583-9112-c342d4cd59ea tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:50.069267 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-7aac4af7-8968-4583-9112-c342d4cd59ea tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024" status: 200 len: 1362 microversion: 2.1 time: 0.198217 Aug 10 11:37:50.070504 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 303/603] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:49 2022] GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024 => generated 1362 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:51.090743 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-9dac4c70-cd5d-4cb1-9cff-ba26c0f812fa tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:51.092126 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-9dac4c70-cd5d-4cb1-9cff-ba26c0f812fa tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: ae770112-a153-4fc8-97ea-637cd10d7024] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:51.098468 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9dac4c70-cd5d-4cb1-9cff-ba26c0f812fa tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:51.098945 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9dac4c70-cd5d-4cb1-9cff-ba26c0f812fa tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:51.100336 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9dac4c70-cd5d-4cb1-9cff-ba26c0f812fa tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:51.100336 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9dac4c70-cd5d-4cb1-9cff-ba26c0f812fa tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:51.100601 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9dac4c70-cd5d-4cb1-9cff-ba26c0f812fa tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:51.101100 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9dac4c70-cd5d-4cb1-9cff-ba26c0f812fa tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:51.237449 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-9dac4c70-cd5d-4cb1-9cff-ba26c0f812fa tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:51.244969 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-9dac4c70-cd5d-4cb1-9cff-ba26c0f812fa tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024" status: 200 len: 1362 microversion: 2.1 time: 0.158138 Aug 10 11:37:51.245541 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 301/604] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:51 2022] GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:51.743356 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-6070e4e1-8287-4020-893a-0e86a62e3ba4 req-7d07039b-9810-4595-898b-f9f4ec9a6c12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae770112-a153-4fc8-97ea-637cd10d7024", "name": "network-vif-plugged", "status": "completed", "tag": "c38a855d-5851-489c-ad2f-d32c8362217b"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:37:51.754874 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-6070e4e1-8287-4020-893a-0e86a62e3ba4 req-7d07039b-9810-4595-898b-f9f4ec9a6c12 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:51.755352 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-6070e4e1-8287-4020-893a-0e86a62e3ba4 req-7d07039b-9810-4595-898b-f9f4ec9a6c12 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:51.755785 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-6070e4e1-8287-4020-893a-0e86a62e3ba4 req-7d07039b-9810-4595-898b-f9f4ec9a6c12 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:51.766853 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-6070e4e1-8287-4020-893a-0e86a62e3ba4 req-7d07039b-9810-4595-898b-f9f4ec9a6c12 service nova] Creating event network-vif-plugged:c38a855d-5851-489c-ad2f-d32c8362217b for instance ae770112-a153-4fc8-97ea-637cd10d7024 on hv-cinder-85272 Aug 10 11:37:51.771878 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-6070e4e1-8287-4020-893a-0e86a62e3ba4 req-7d07039b-9810-4595-898b-f9f4ec9a6c12 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032652 Aug 10 11:37:51.772507 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 304/605] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:37:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:37:52.266122 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-031452f7-5e8f-48bf-9d2f-4f8c17055cc1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:52.266726 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-031452f7-5e8f-48bf-9d2f-4f8c17055cc1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: ae770112-a153-4fc8-97ea-637cd10d7024] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:52.273029 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-031452f7-5e8f-48bf-9d2f-4f8c17055cc1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:52.273506 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-031452f7-5e8f-48bf-9d2f-4f8c17055cc1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:52.273941 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-031452f7-5e8f-48bf-9d2f-4f8c17055cc1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:52.274621 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-031452f7-5e8f-48bf-9d2f-4f8c17055cc1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:52.275070 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-031452f7-5e8f-48bf-9d2f-4f8c17055cc1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:52.275490 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-031452f7-5e8f-48bf-9d2f-4f8c17055cc1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:52.407353 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-031452f7-5e8f-48bf-9d2f-4f8c17055cc1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:52.414645 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-031452f7-5e8f-48bf-9d2f-4f8c17055cc1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024" status: 200 len: 1362 microversion: 2.1 time: 0.152775 Aug 10 11:37:52.415207 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 302/606] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:52 2022] GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:37:53.082791 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-c4540959-e520-40d0-9f92-6e46a7428720 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:53.083799 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-c4540959-e520-40d0-9f92-6e46a7428720 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:53.090501 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c4540959-e520-40d0-9f92-6e46a7428720 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:53.091719 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c4540959-e520-40d0-9f92-6e46a7428720 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:53.092213 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c4540959-e520-40d0-9f92-6e46a7428720 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:53.092921 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c4540959-e520-40d0-9f92-6e46a7428720 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:53.093383 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c4540959-e520-40d0-9f92-6e46a7428720 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:53.093814 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c4540959-e520-40d0-9f92-6e46a7428720 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:53.119807 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-c4540959-e520-40d0-9f92-6e46a7428720 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Going to try to terminate instance {{(pid=124683) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:37:53.376910 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-c4540959-e520-40d0-9f92-6e46a7428720 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "DELETE /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 204 len: 0 microversion: 2.1 time: 0.298917 Aug 10 11:37:53.377496 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 305/607] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 10 11:37:53 2022] DELETE /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:37:53.385430 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-32a8a251-ef05-4c06-931e-e9d6967d8c96 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:53.386060 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-32a8a251-ef05-4c06-931e-e9d6967d8c96 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:53.393675 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-32a8a251-ef05-4c06-931e-e9d6967d8c96 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:53.394297 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-32a8a251-ef05-4c06-931e-e9d6967d8c96 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:53.394668 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-32a8a251-ef05-4c06-931e-e9d6967d8c96 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:53.395387 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-32a8a251-ef05-4c06-931e-e9d6967d8c96 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:53.395843 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-32a8a251-ef05-4c06-931e-e9d6967d8c96 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:53.396315 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-32a8a251-ef05-4c06-931e-e9d6967d8c96 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:53.436669 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-82c2d409-86e3-4cab-8d69-e17ca0d433e1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:53.437376 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-82c2d409-86e3-4cab-8d69-e17ca0d433e1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: ae770112-a153-4fc8-97ea-637cd10d7024] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:53.443983 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-82c2d409-86e3-4cab-8d69-e17ca0d433e1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:53.444628 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-82c2d409-86e3-4cab-8d69-e17ca0d433e1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:53.445067 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-82c2d409-86e3-4cab-8d69-e17ca0d433e1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:53.445840 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-82c2d409-86e3-4cab-8d69-e17ca0d433e1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:53.446293 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-82c2d409-86e3-4cab-8d69-e17ca0d433e1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:53.446946 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-82c2d409-86e3-4cab-8d69-e17ca0d433e1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:53.532722 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-32a8a251-ef05-4c06-931e-e9d6967d8c96 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:53.542004 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-32a8a251-ef05-4c06-931e-e9d6967d8c96 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1507 microversion: 2.1 time: 0.159961 Aug 10 11:37:53.543715 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 303/608] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:53 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:53.599685 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-82c2d409-86e3-4cab-8d69-e17ca0d433e1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:53.607255 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-82c2d409-86e3-4cab-8d69-e17ca0d433e1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024" status: 200 len: 1362 microversion: 2.1 time: 0.175616 Aug 10 11:37:53.607813 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 306/609] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:53 2022] GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024 => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:37:54.563931 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-57cc148f-f116-41aa-80d8-9d9596509d9b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:54.564499 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-57cc148f-f116-41aa-80d8-9d9596509d9b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:54.571068 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-57cc148f-f116-41aa-80d8-9d9596509d9b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:54.571550 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-57cc148f-f116-41aa-80d8-9d9596509d9b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:54.572007 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-57cc148f-f116-41aa-80d8-9d9596509d9b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:54.572824 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-57cc148f-f116-41aa-80d8-9d9596509d9b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:54.573275 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-57cc148f-f116-41aa-80d8-9d9596509d9b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:54.573700 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-57cc148f-f116-41aa-80d8-9d9596509d9b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:54.628936 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-dbf87927-6789-4498-8520-542d94b88b39 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:54.629554 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-dbf87927-6789-4498-8520-542d94b88b39 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: ae770112-a153-4fc8-97ea-637cd10d7024] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:54.636101 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-dbf87927-6789-4498-8520-542d94b88b39 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:54.636595 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-dbf87927-6789-4498-8520-542d94b88b39 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:54.637033 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-dbf87927-6789-4498-8520-542d94b88b39 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:54.638277 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-dbf87927-6789-4498-8520-542d94b88b39 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:54.638736 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-dbf87927-6789-4498-8520-542d94b88b39 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:54.639174 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-dbf87927-6789-4498-8520-542d94b88b39 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:54.714532 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-57cc148f-f116-41aa-80d8-9d9596509d9b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:54.722655 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-57cc148f-f116-41aa-80d8-9d9596509d9b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1507 microversion: 2.1 time: 0.162595 Aug 10 11:37:54.723228 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 304/610] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:54 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:54.783275 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-dbf87927-6789-4498-8520-542d94b88b39 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:54.790991 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-dbf87927-6789-4498-8520-542d94b88b39 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024" status: 200 len: 1548 microversion: 2.1 time: 0.165930 Aug 10 11:37:54.791734 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 307/611] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:54 2022] GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024 => generated 1548 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:37:54.812612 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-05b0d8e7-f75f-4659-8bd7-08b7c31de131 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:54.814774 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-05b0d8e7-f75f-4659-8bd7-08b7c31de131 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: ae770112-a153-4fc8-97ea-637cd10d7024] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:54.819732 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-05b0d8e7-f75f-4659-8bd7-08b7c31de131 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:54.820172 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-05b0d8e7-f75f-4659-8bd7-08b7c31de131 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:54.820711 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-05b0d8e7-f75f-4659-8bd7-08b7c31de131 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:54.821405 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-05b0d8e7-f75f-4659-8bd7-08b7c31de131 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:54.821862 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-05b0d8e7-f75f-4659-8bd7-08b7c31de131 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:54.822289 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-05b0d8e7-f75f-4659-8bd7-08b7c31de131 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:54.902108 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-05b0d8e7-f75f-4659-8bd7-08b7c31de131 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094116 Aug 10 11:37:54.902699 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 305/612] 10.222.0.62 () {58 vars in 1275 bytes} [Wed Aug 10 11:37:54 2022] GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:37:55.745438 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-29ef820d-ea92-4566-a819-dc41f51edf0b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:55.745998 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-29ef820d-ea92-4566-a819-dc41f51edf0b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:55.752973 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-29ef820d-ea92-4566-a819-dc41f51edf0b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:55.753492 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-29ef820d-ea92-4566-a819-dc41f51edf0b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:55.753935 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-29ef820d-ea92-4566-a819-dc41f51edf0b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:55.754634 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-29ef820d-ea92-4566-a819-dc41f51edf0b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:55.755094 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-29ef820d-ea92-4566-a819-dc41f51edf0b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:55.755521 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-29ef820d-ea92-4566-a819-dc41f51edf0b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:55.759589 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:37:56.070480 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-29ef820d-ea92-4566-a819-dc41f51edf0b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:56.078642 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-29ef820d-ea92-4566-a819-dc41f51edf0b tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1507 microversion: 2.1 time: 0.337143 Aug 10 11:37:56.079216 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 308/613] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:55 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1507 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:56.108371 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-89791495-94bf-4940-b88a-ca79a0610233 req-54cfdda1-37fd-4387-a3d4-deca2d3d3bfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae770112-a153-4fc8-97ea-637cd10d7024", "tag": "c38a855d-5851-489c-ad2f-d32c8362217b"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:37:56.118526 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-89791495-94bf-4940-b88a-ca79a0610233 req-54cfdda1-37fd-4387-a3d4-deca2d3d3bfe service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:56.119006 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-89791495-94bf-4940-b88a-ca79a0610233 req-54cfdda1-37fd-4387-a3d4-deca2d3d3bfe service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:56.119470 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-89791495-94bf-4940-b88a-ca79a0610233 req-54cfdda1-37fd-4387-a3d4-deca2d3d3bfe service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:56.131243 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-89791495-94bf-4940-b88a-ca79a0610233 req-54cfdda1-37fd-4387-a3d4-deca2d3d3bfe service nova] Creating event network-changed:c38a855d-5851-489c-ad2f-d32c8362217b for instance ae770112-a153-4fc8-97ea-637cd10d7024 on hv-cinder-85272 Aug 10 11:37:56.136318 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-89791495-94bf-4940-b88a-ca79a0610233 req-54cfdda1-37fd-4387-a3d4-deca2d3d3bfe service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032202 Aug 10 11:37:56.137120 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 306/614] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:37:57.099802 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-a1e732f1-aeb9-42ba-aacc-a581bf889bb6 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:57.100430 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-a1e732f1-aeb9-42ba-aacc-a581bf889bb6 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:57.109970 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a1e732f1-aeb9-42ba-aacc-a581bf889bb6 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:57.109970 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a1e732f1-aeb9-42ba-aacc-a581bf889bb6 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:57.109970 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a1e732f1-aeb9-42ba-aacc-a581bf889bb6 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:57.109970 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a1e732f1-aeb9-42ba-aacc-a581bf889bb6 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:57.110401 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a1e732f1-aeb9-42ba-aacc-a581bf889bb6 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:57.110401 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a1e732f1-aeb9-42ba-aacc-a581bf889bb6 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:57.144601 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a1e732f1-aeb9-42ba-aacc-a581bf889bb6 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:57.145087 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a1e732f1-aeb9-42ba-aacc-a581bf889bb6 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:57.145517 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a1e732f1-aeb9-42ba-aacc-a581bf889bb6 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:57.145963 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.objects.instance [None req-a1e732f1-aeb9-42ba-aacc-a581bf889bb6 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lazy-loading 'fault' on Instance uuid 23e6c8bd-1889-4c18-9580-0022eb962549 {{(pid=124683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:37:57.189635 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-a1e732f1-aeb9-42ba-aacc-a581bf889bb6 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:57.197193 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-a1e732f1-aeb9-42ba-aacc-a581bf889bb6 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 200 len: 1311 microversion: 2.1 time: 0.101235 Aug 10 11:37:57.197772 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 309/615] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:57 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 1311 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:58.175441 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-8d881d33-5844-4b54-83a9-a956a3dfcb28 req-23360955-56c4-4ed0-9362-809711ddbc27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23e6c8bd-1889-4c18-9580-0022eb962549", "name": "network-vif-deleted", "tag": "8069a065-c0f3-4da4-a7ea-aadcc5bfe815"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:37:58.186323 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-8d881d33-5844-4b54-83a9-a956a3dfcb28 req-23360955-56c4-4ed0-9362-809711ddbc27 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:58.187532 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-8d881d33-5844-4b54-83a9-a956a3dfcb28 req-23360955-56c4-4ed0-9362-809711ddbc27 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:58.188173 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-8d881d33-5844-4b54-83a9-a956a3dfcb28 req-23360955-56c4-4ed0-9362-809711ddbc27 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:58.199055 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-8d881d33-5844-4b54-83a9-a956a3dfcb28 req-23360955-56c4-4ed0-9362-809711ddbc27 service nova] Creating event network-vif-deleted:8069a065-c0f3-4da4-a7ea-aadcc5bfe815 for instance 23e6c8bd-1889-4c18-9580-0022eb962549 on hv-cinder-85272 Aug 10 11:37:58.204646 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-8d881d33-5844-4b54-83a9-a956a3dfcb28 req-23360955-56c4-4ed0-9362-809711ddbc27 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037034 Aug 10 11:37:58.205259 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 307/616] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:37:58.219025 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-9aa07d16-6f4f-41ed-b9c2-a63e729b2438 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:58.220170 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-9aa07d16-6f4f-41ed-b9c2-a63e729b2438 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 23e6c8bd-1889-4c18-9580-0022eb962549] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:58.226931 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9aa07d16-6f4f-41ed-b9c2-a63e729b2438 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:58.227409 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9aa07d16-6f4f-41ed-b9c2-a63e729b2438 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:58.227839 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9aa07d16-6f4f-41ed-b9c2-a63e729b2438 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:58.228569 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9aa07d16-6f4f-41ed-b9c2-a63e729b2438 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:58.229019 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9aa07d16-6f4f-41ed-b9c2-a63e729b2438 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:58.229441 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9aa07d16-6f4f-41ed-b9c2-a63e729b2438 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:58.243004 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-9aa07d16-6f4f-41ed-b9c2-a63e729b2438 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] HTTP exception thrown: Instance 23e6c8bd-1889-4c18-9580-0022eb962549 could not be found. Aug 10 11:37:58.246052 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-9aa07d16-6f4f-41ed-b9c2-a63e729b2438 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Request method failure captured: Aug 10 11:37:58.246052 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: request: GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 HTTP/1.1 Aug 10 11:37:58.246052 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept: application/json Aug 10 11:37:58.246052 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Aug 10 11:37:58.246052 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Connection: close Aug 10 11:37:58.246052 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Length: 0 Aug 10 11:37:58.246052 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Type: application/json Aug 10 11:37:58.246052 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Host: 10.222.0.62 Aug 10 11:37:58.246052 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Aug 10 11:37:58.246052 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.11 Aug 10 11:37:58.246052 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABi85diKAHwXRzd2il03BjBn4GtPc8kISXNr_WlbPfAO6ScxlA2xKRFTXp6lv4Mx70H4OHfMxyACT9qtANdjRUlG0IXG7zsJ6Yh5tFE6PbxXVb6Pm5mIqh7eSEB9wtnuv9htvQ1QMN0TYW9yui41zYItyS58rcQtQxa6iH9KCT_lRB8CpA Aug 10 11:37:58.246052 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Aug 10 11:37:58.246052 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Aug 10 11:37:58.246052 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Aug 10 11:37:58.246052 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Aug 10 11:37:58.246052 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Aug 10 11:37:58.246052 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Aug 10 11:37:58.246052 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Id: a66fd06041084a16b8d5c5b9a9dbea52 Aug 10 11:37:58.246052 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-956924328 Aug 10 11:37:58.246052 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Role: member,reader Aug 10 11:37:58.246052 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Aug 10 11:37:58.248265 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/a66fd06041084a16b8d5c5b9a9dbea52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_a66fd06041084a16b8d5c5b9a9dbea52", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a66fd06041084a16b8d5c5b9a9dbea52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a66fd06041084a16b8d5c5b9a9dbea52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:37:58.248265 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-ServerRescueNegativeTestJSON-956924328 Aug 10 11:37:58.248265 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Id: a66fd06041084a16b8d5c5b9a9dbea52 Aug 10 11:37:58.248265 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-956924328 Aug 10 11:37:58.248265 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User: tempest-ServerRescueNegativeTestJSON-956924328-project Aug 10 11:37:58.248265 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Aug 10 11:37:58.248265 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Aug 10 11:37:58.248265 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Id: 81be34fdd1d741719b317b4fed21636d Aug 10 11:37:58.248265 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-ServerRescueNegativeTestJSON-956924328-project Aug 10 11:37:58.248265 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: method: > Aug 10 11:37:58.248265 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: exception: Instance 23e6c8bd-1889-4c18-9580-0022eb962549 could not be found. Aug 10 11:37:58.248265 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: action_args: {'id': '23e6c8bd-1889-4c18-9580-0022eb962549'} Aug 10 11:37:58.249148 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:37:58.249148 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:37:58.249148 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:37:58.249148 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:37:58.249148 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:37:58.249148 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:37:58.249148 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:37:58.249148 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:37:58.249148 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:37:58.249148 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:37:58.249148 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23e6c8bd-1889-4c18-9580-0022eb962549 could not be found. Aug 10 11:37:58.249148 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:37:58.249148 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:37:58.249148 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:37:58.249148 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:37:58.249148 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:37:58.249148 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:37:58.249148 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:37:58.249148 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:37:58.249148 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:37:58.250592 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:37:58.250592 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:37:58.250592 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:37:58.250592 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:37:58.250592 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:37:58.250592 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:37:58.250592 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:37:58.250592 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23e6c8bd-1889-4c18-9580-0022eb962549 could not be found. Aug 10 11:37:58.250592 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:37:58.250592 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:37:58.250592 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:37:58.250592 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:37:58.250592 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:37:58.250592 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:37:58.250592 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:37:58.250592 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:37:58.250592 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23e6c8bd-1889-4c18-9580-0022eb962549 could not be found. Aug 10 11:37:58.250592 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:37:58.251877 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-9aa07d16-6f4f-41ed-b9c2-a63e729b2438 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Returning 404 to user: Instance 23e6c8bd-1889-4c18-9580-0022eb962549 could not be found. {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:37:58.251877 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-9aa07d16-6f4f-41ed-b9c2-a63e729b2438 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549" status: 404 len: 111 microversion: 2.1 time: 0.031334 Aug 10 11:37:58.251877 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 310/617] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:58 2022] GET /compute/v2.1/servers/23e6c8bd-1889-4c18-9580-0022eb962549 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:37:58.255679 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-ecf72ecf-0e89-425f-8f6f-bde7fecc669a tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:58.256238 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-ecf72ecf-0e89-425f-8f6f-bde7fecc669a tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 85d76c52-fcda-4805-aa95-a00f88e39970] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:58.262342 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ecf72ecf-0e89-425f-8f6f-bde7fecc669a tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:58.263006 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ecf72ecf-0e89-425f-8f6f-bde7fecc669a tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:58.263457 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ecf72ecf-0e89-425f-8f6f-bde7fecc669a tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:58.264178 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ecf72ecf-0e89-425f-8f6f-bde7fecc669a tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:58.264644 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ecf72ecf-0e89-425f-8f6f-bde7fecc669a tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:58.265070 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ecf72ecf-0e89-425f-8f6f-bde7fecc669a tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:58.290081 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-ecf72ecf-0e89-425f-8f6f-bde7fecc669a tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 85d76c52-fcda-4805-aa95-a00f88e39970] Going to try to terminate instance {{(pid=124682) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:37:58.542652 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-ecf72ecf-0e89-425f-8f6f-bde7fecc669a tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "DELETE /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970" status: 204 len: 0 microversion: 2.1 time: 0.290821 Aug 10 11:37:58.543171 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 308/618] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 10 11:37:58 2022] DELETE /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:37:58.552481 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-a8df2cf3-7d94-45b4-824c-67bab65ec5d2 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:58.553094 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-a8df2cf3-7d94-45b4-824c-67bab65ec5d2 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 85d76c52-fcda-4805-aa95-a00f88e39970] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:58.559100 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a8df2cf3-7d94-45b4-824c-67bab65ec5d2 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:58.559602 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a8df2cf3-7d94-45b4-824c-67bab65ec5d2 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:58.560058 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a8df2cf3-7d94-45b4-824c-67bab65ec5d2 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:58.560743 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a8df2cf3-7d94-45b4-824c-67bab65ec5d2 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:58.561193 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a8df2cf3-7d94-45b4-824c-67bab65ec5d2 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:58.561623 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a8df2cf3-7d94-45b4-824c-67bab65ec5d2 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:58.715361 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-a8df2cf3-7d94-45b4-824c-67bab65ec5d2 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:58.723980 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-a8df2cf3-7d94-45b4-824c-67bab65ec5d2 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970" status: 200 len: 1521 microversion: 2.1 time: 0.175507 Aug 10 11:37:58.728882 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 311/619] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:58 2022] GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:59.745536 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-b9736016-ddc7-4704-ac8c-a552c5bf07d8 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:59.746233 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-b9736016-ddc7-4704-ac8c-a552c5bf07d8 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 85d76c52-fcda-4805-aa95-a00f88e39970] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:59.752766 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b9736016-ddc7-4704-ac8c-a552c5bf07d8 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:59.753243 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b9736016-ddc7-4704-ac8c-a552c5bf07d8 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:59.754935 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b9736016-ddc7-4704-ac8c-a552c5bf07d8 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:59.754935 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b9736016-ddc7-4704-ac8c-a552c5bf07d8 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:59.754935 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b9736016-ddc7-4704-ac8c-a552c5bf07d8 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:59.755231 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b9736016-ddc7-4704-ac8c-a552c5bf07d8 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:59.888871 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b9736016-ddc7-4704-ac8c-a552c5bf07d8 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:59.896620 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-b9736016-ddc7-4704-ac8c-a552c5bf07d8 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970" status: 200 len: 1521 microversion: 2.1 time: 0.155495 Aug 10 11:37:59.897187 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 309/620] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:59 2022] GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:38:00.916585 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-9ffb6afd-c878-4732-bd68-ee28668fcdce tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:38:00.917198 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-9ffb6afd-c878-4732-bd68-ee28668fcdce tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 85d76c52-fcda-4805-aa95-a00f88e39970] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:00.923700 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9ffb6afd-c878-4732-bd68-ee28668fcdce tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:00.924219 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9ffb6afd-c878-4732-bd68-ee28668fcdce tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:00.924660 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9ffb6afd-c878-4732-bd68-ee28668fcdce tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:00.925352 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9ffb6afd-c878-4732-bd68-ee28668fcdce tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:00.925805 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9ffb6afd-c878-4732-bd68-ee28668fcdce tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:00.926231 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9ffb6afd-c878-4732-bd68-ee28668fcdce tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:01.055210 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-9ffb6afd-c878-4732-bd68-ee28668fcdce tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:01.063758 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-9ffb6afd-c878-4732-bd68-ee28668fcdce tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970" status: 200 len: 1521 microversion: 2.1 time: 0.150996 Aug 10 11:38:01.064367 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 312/621] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:38:00 2022] GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:38:02.084654 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-98373e50-eece-4238-b765-aef8ccac529c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:38:02.085267 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-98373e50-eece-4238-b765-aef8ccac529c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 85d76c52-fcda-4805-aa95-a00f88e39970] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:02.092446 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-98373e50-eece-4238-b765-aef8ccac529c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:02.092939 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-98373e50-eece-4238-b765-aef8ccac529c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:02.093377 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-98373e50-eece-4238-b765-aef8ccac529c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:02.094075 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-98373e50-eece-4238-b765-aef8ccac529c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:02.094530 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-98373e50-eece-4238-b765-aef8ccac529c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:02.094967 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-98373e50-eece-4238-b765-aef8ccac529c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:02.099020 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:38:02.308107 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-ce86f546-0b59-4209-8d7f-9b0109f58813 req-09620548-6935-4686-a579-762ed8cbce31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85d76c52-fcda-4805-aa95-a00f88e39970", "name": "network-vif-deleted", "tag": "e488c9e1-d9f1-4e1f-8ee8-652d229c8978"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:38:02.309030 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-98373e50-eece-4238-b765-aef8ccac529c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be34fdd1d741719b317b4fed21636d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66fd06041084a16b8d5c5b9a9dbea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:02.317371 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-98373e50-eece-4238-b765-aef8ccac529c tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970" status: 200 len: 1521 microversion: 2.1 time: 0.236527 Aug 10 11:38:02.317941 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 310/622] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:38:02 2022] GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:38:02.318703 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-ce86f546-0b59-4209-8d7f-9b0109f58813 req-09620548-6935-4686-a579-762ed8cbce31 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:02.321193 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-ce86f546-0b59-4209-8d7f-9b0109f58813 req-09620548-6935-4686-a579-762ed8cbce31 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:02.321193 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-ce86f546-0b59-4209-8d7f-9b0109f58813 req-09620548-6935-4686-a579-762ed8cbce31 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:02.331565 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-ce86f546-0b59-4209-8d7f-9b0109f58813 req-09620548-6935-4686-a579-762ed8cbce31 service nova] Creating event network-vif-deleted:e488c9e1-d9f1-4e1f-8ee8-652d229c8978 for instance 85d76c52-fcda-4805-aa95-a00f88e39970 on hv-cinder-85272 Aug 10 11:38:02.336778 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-ce86f546-0b59-4209-8d7f-9b0109f58813 req-09620548-6935-4686-a579-762ed8cbce31 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032582 Aug 10 11:38:02.337359 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 313/623] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:38:03.339672 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-e1792a1e-394c-4156-a0d5-98fd563c0192 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:38:03.340651 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-e1792a1e-394c-4156-a0d5-98fd563c0192 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] [instance: 85d76c52-fcda-4805-aa95-a00f88e39970] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:03.347487 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e1792a1e-394c-4156-a0d5-98fd563c0192 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:03.347982 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e1792a1e-394c-4156-a0d5-98fd563c0192 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:03.348429 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e1792a1e-394c-4156-a0d5-98fd563c0192 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:03.349107 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e1792a1e-394c-4156-a0d5-98fd563c0192 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:03.349556 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e1792a1e-394c-4156-a0d5-98fd563c0192 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:03.349976 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e1792a1e-394c-4156-a0d5-98fd563c0192 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:03.363731 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.wsgi [None req-e1792a1e-394c-4156-a0d5-98fd563c0192 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] HTTP exception thrown: Instance 85d76c52-fcda-4805-aa95-a00f88e39970 could not be found. Aug 10 11:38:03.365369 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-e1792a1e-394c-4156-a0d5-98fd563c0192 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Request method failure captured: Aug 10 11:38:03.365369 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: request: GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970 HTTP/1.1 Aug 10 11:38:03.365369 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Accept: application/json Aug 10 11:38:03.365369 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Aug 10 11:38:03.365369 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Connection: close Aug 10 11:38:03.365369 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Content-Length: 0 Aug 10 11:38:03.365369 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Content-Type: application/json Aug 10 11:38:03.365369 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Host: 10.222.0.62 Aug 10 11:38:03.365369 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Aug 10 11:38:03.365369 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.11 Aug 10 11:38:03.365369 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABi85diKAHwXRzd2il03BjBn4GtPc8kISXNr_WlbPfAO6ScxlA2xKRFTXp6lv4Mx70H4OHfMxyACT9qtANdjRUlG0IXG7zsJ6Yh5tFE6PbxXVb6Pm5mIqh7eSEB9wtnuv9htvQ1QMN0TYW9yui41zYItyS58rcQtQxa6iH9KCT_lRB8CpA Aug 10 11:38:03.365369 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Aug 10 11:38:03.365369 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Aug 10 11:38:03.365369 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Aug 10 11:38:03.365369 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Aug 10 11:38:03.365369 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Aug 10 11:38:03.365369 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Aug 10 11:38:03.365369 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Id: a66fd06041084a16b8d5c5b9a9dbea52 Aug 10 11:38:03.365369 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-956924328 Aug 10 11:38:03.365369 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Role: member,reader Aug 10 11:38:03.365369 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Aug 10 11:38:03.366906 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/a66fd06041084a16b8d5c5b9a9dbea52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_a66fd06041084a16b8d5c5b9a9dbea52", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a66fd06041084a16b8d5c5b9a9dbea52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a66fd06041084a16b8d5c5b9a9dbea52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:38:03.366906 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-ServerRescueNegativeTestJSON-956924328 Aug 10 11:38:03.366906 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant-Id: a66fd06041084a16b8d5c5b9a9dbea52 Aug 10 11:38:03.366906 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-956924328 Aug 10 11:38:03.366906 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User: tempest-ServerRescueNegativeTestJSON-956924328-project Aug 10 11:38:03.366906 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Aug 10 11:38:03.366906 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Aug 10 11:38:03.366906 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Id: 81be34fdd1d741719b317b4fed21636d Aug 10 11:38:03.366906 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-ServerRescueNegativeTestJSON-956924328-project Aug 10 11:38:03.366906 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: method: > Aug 10 11:38:03.366906 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: exception: Instance 85d76c52-fcda-4805-aa95-a00f88e39970 could not be found. Aug 10 11:38:03.366906 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: action_args: {'id': '85d76c52-fcda-4805-aa95-a00f88e39970'} Aug 10 11:38:03.367786 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:38:03.367786 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:38:03.367786 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:38:03.367786 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:38:03.367786 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:38:03.367786 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:38:03.367786 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:38:03.367786 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:38:03.367786 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:38:03.367786 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:38:03.367786 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85d76c52-fcda-4805-aa95-a00f88e39970 could not be found. Aug 10 11:38:03.367786 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:38:03.367786 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:38:03.367786 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:38:03.367786 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:38:03.367786 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:38:03.367786 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:38:03.367786 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:38:03.367786 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:38:03.367786 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:38:03.369337 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:38:03.369337 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:38:03.369337 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:38:03.369337 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:38:03.369337 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:38:03.369337 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:38:03.369337 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:38:03.369337 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85d76c52-fcda-4805-aa95-a00f88e39970 could not be found. Aug 10 11:38:03.369337 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:38:03.369337 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:38:03.369337 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:38:03.369337 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:38:03.369337 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:38:03.369337 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:38:03.369337 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:38:03.369337 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:38:03.369337 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85d76c52-fcda-4805-aa95-a00f88e39970 could not be found. Aug 10 11:38:03.369337 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:38:03.370621 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-e1792a1e-394c-4156-a0d5-98fd563c0192 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] Returning 404 to user: Instance 85d76c52-fcda-4805-aa95-a00f88e39970 could not be found. {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:38:03.370621 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-e1792a1e-394c-4156-a0d5-98fd563c0192 tempest-ServerRescueNegativeTestJSON-956924328 tempest-ServerRescueNegativeTestJSON-956924328-project] 10.222.0.62 "GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970" status: 404 len: 111 microversion: 2.1 time: 0.031065 Aug 10 11:38:03.370621 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 311/624] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:38:03 2022] GET /compute/v2.1/servers/85d76c52-fcda-4805-aa95-a00f88e39970 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:38:09.168015 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-80d7d34a-f888-4aed-9f49-d43fd4e40e83 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:38:09.170938 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-80d7d34a-f888-4aed-9f49-d43fd4e40e83 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:09.177466 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-80d7d34a-f888-4aed-9f49-d43fd4e40e83 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:09.182216 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-80d7d34a-f888-4aed-9f49-d43fd4e40e83 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:09.182216 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-80d7d34a-f888-4aed-9f49-d43fd4e40e83 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:09.182216 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-80d7d34a-f888-4aed-9f49-d43fd4e40e83 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:09.182216 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-80d7d34a-f888-4aed-9f49-d43fd4e40e83 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:09.182697 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-80d7d34a-f888-4aed-9f49-d43fd4e40e83 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:09.203563 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-80d7d34a-f888-4aed-9f49-d43fd4e40e83 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8/ips" status: 200 len: 152 microversion: 2.20 time: 0.303628 Aug 10 11:38:09.204658 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 314/625] 10.222.0.62 () {60 vars in 1289 bytes} [Wed Aug 10 11:38:08 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8/ips => generated 152 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:38:11.327458 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-7f2a720c-82b0-467a-bbad-8965d35ce905 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:38:11.328102 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-7f2a720c-82b0-467a-bbad-8965d35ce905 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:11.334757 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7f2a720c-82b0-467a-bbad-8965d35ce905 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:11.340964 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7f2a720c-82b0-467a-bbad-8965d35ce905 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:11.340964 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7f2a720c-82b0-467a-bbad-8965d35ce905 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:11.340964 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7f2a720c-82b0-467a-bbad-8965d35ce905 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:11.340964 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7f2a720c-82b0-467a-bbad-8965d35ce905 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:11.341521 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7f2a720c-82b0-467a-bbad-8965d35ce905 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:11.365993 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.objects.instance [None req-7f2a720c-82b0-467a-bbad-8965d35ce905 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lazy-loading 'flavor' on Instance uuid 865edaf1-a2d9-492e-af4c-05e5aecd6cf8 {{(pid=124682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:38:11.785208 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-7f2a720c-82b0-467a-bbad-8965d35ce905 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "POST /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8/action" status: 202 len: 0 microversion: 2.20 time: 0.462232 Aug 10 11:38:11.794878 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 312/626] 10.222.0.62 () {62 vars in 1319 bytes} [Wed Aug 10 11:38:11 2022] POST /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8/action => generated 0 bytes in 464 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:38:11.795940 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-5dba9857-6670-4dd4-9046-63ae1d503bbe tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:38:11.796599 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-5dba9857-6670-4dd4-9046-63ae1d503bbe tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:11.803172 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5dba9857-6670-4dd4-9046-63ae1d503bbe tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:11.803656 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5dba9857-6670-4dd4-9046-63ae1d503bbe tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:11.804130 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5dba9857-6670-4dd4-9046-63ae1d503bbe tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:11.804858 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5dba9857-6670-4dd4-9046-63ae1d503bbe tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:11.805315 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5dba9857-6670-4dd4-9046-63ae1d503bbe tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:11.805710 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5dba9857-6670-4dd4-9046-63ae1d503bbe tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:11.952201 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-5dba9857-6670-4dd4-9046-63ae1d503bbe tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:11.960781 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-5dba9857-6670-4dd4-9046-63ae1d503bbe tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:11.962303 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-5dba9857-6670-4dd4-9046-63ae1d503bbe tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:11.963471 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-5dba9857-6670-4dd4-9046-63ae1d503bbe tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1723 microversion: 2.20 time: 0.173367 Aug 10 11:38:11.964113 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 315/627] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:38:11 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:38:12.989294 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-c3d842b2-b5d6-4f35-bc2f-0237b2afb449 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:38:12.989998 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-c3d842b2-b5d6-4f35-bc2f-0237b2afb449 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:12.996267 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c3d842b2-b5d6-4f35-bc2f-0237b2afb449 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:12.996776 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c3d842b2-b5d6-4f35-bc2f-0237b2afb449 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:12.997206 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c3d842b2-b5d6-4f35-bc2f-0237b2afb449 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:12.997994 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c3d842b2-b5d6-4f35-bc2f-0237b2afb449 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:12.998450 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c3d842b2-b5d6-4f35-bc2f-0237b2afb449 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:12.998879 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c3d842b2-b5d6-4f35-bc2f-0237b2afb449 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:13.135238 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c3d842b2-b5d6-4f35-bc2f-0237b2afb449 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:13.139979 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c3d842b2-b5d6-4f35-bc2f-0237b2afb449 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:13.141752 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c3d842b2-b5d6-4f35-bc2f-0237b2afb449 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:13.142916 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-c3d842b2-b5d6-4f35-bc2f-0237b2afb449 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1723 microversion: 2.20 time: 0.158352 Aug 10 11:38:13.143470 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 313/628] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:38:12 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:38:14.174534 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-9b7db5b0-6ff9-4721-aeed-bd411f7b37c4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:38:14.175300 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-9b7db5b0-6ff9-4721-aeed-bd411f7b37c4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:14.182061 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9b7db5b0-6ff9-4721-aeed-bd411f7b37c4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:14.182846 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9b7db5b0-6ff9-4721-aeed-bd411f7b37c4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:14.183343 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9b7db5b0-6ff9-4721-aeed-bd411f7b37c4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:14.184157 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9b7db5b0-6ff9-4721-aeed-bd411f7b37c4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:14.184689 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9b7db5b0-6ff9-4721-aeed-bd411f7b37c4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:14.185812 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9b7db5b0-6ff9-4721-aeed-bd411f7b37c4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:14.316453 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-9b7db5b0-6ff9-4721-aeed-bd411f7b37c4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:14.324263 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-9b7db5b0-6ff9-4721-aeed-bd411f7b37c4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:14.325793 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-9b7db5b0-6ff9-4721-aeed-bd411f7b37c4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:14.326928 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-9b7db5b0-6ff9-4721-aeed-bd411f7b37c4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1723 microversion: 2.20 time: 0.156876 Aug 10 11:38:14.327484 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 316/629] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:38:14 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:38:15.348940 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-0ee58b1c-ad8b-4964-9186-8f0300c5c92b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:38:15.349550 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-0ee58b1c-ad8b-4964-9186-8f0300c5c92b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:15.356323 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0ee58b1c-ad8b-4964-9186-8f0300c5c92b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:15.356847 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0ee58b1c-ad8b-4964-9186-8f0300c5c92b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:15.357373 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0ee58b1c-ad8b-4964-9186-8f0300c5c92b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:15.357956 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0ee58b1c-ad8b-4964-9186-8f0300c5c92b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:15.358443 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0ee58b1c-ad8b-4964-9186-8f0300c5c92b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:15.358901 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0ee58b1c-ad8b-4964-9186-8f0300c5c92b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:15.494587 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-0ee58b1c-ad8b-4964-9186-8f0300c5c92b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:15.501246 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-0ee58b1c-ad8b-4964-9186-8f0300c5c92b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:15.502737 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-0ee58b1c-ad8b-4964-9186-8f0300c5c92b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:15.503888 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-0ee58b1c-ad8b-4964-9186-8f0300c5c92b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1723 microversion: 2.20 time: 0.158858 Aug 10 11:38:15.504475 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 314/630] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:38:15 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:38:16.527028 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-85cc29ea-ed86-49bc-bfc9-4ecc6a3d06fe tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:38:16.527662 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-85cc29ea-ed86-49bc-bfc9-4ecc6a3d06fe tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:16.534506 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-85cc29ea-ed86-49bc-bfc9-4ecc6a3d06fe tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:16.534990 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-85cc29ea-ed86-49bc-bfc9-4ecc6a3d06fe tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:16.535422 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-85cc29ea-ed86-49bc-bfc9-4ecc6a3d06fe tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:16.536135 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-85cc29ea-ed86-49bc-bfc9-4ecc6a3d06fe tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:16.536585 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-85cc29ea-ed86-49bc-bfc9-4ecc6a3d06fe tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:16.537006 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-85cc29ea-ed86-49bc-bfc9-4ecc6a3d06fe tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:16.673063 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-85cc29ea-ed86-49bc-bfc9-4ecc6a3d06fe tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:16.680882 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-85cc29ea-ed86-49bc-bfc9-4ecc6a3d06fe tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:16.682403 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-85cc29ea-ed86-49bc-bfc9-4ecc6a3d06fe tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:16.683547 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-85cc29ea-ed86-49bc-bfc9-4ecc6a3d06fe tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1723 microversion: 2.20 time: 0.160362 Aug 10 11:38:16.684217 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 317/631] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:38:16 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:38:17.707048 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-dcb6ec24-9246-4fa6-94b8-68329606c143 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:38:17.707623 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-dcb6ec24-9246-4fa6-94b8-68329606c143 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:17.713932 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-dcb6ec24-9246-4fa6-94b8-68329606c143 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:17.714414 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-dcb6ec24-9246-4fa6-94b8-68329606c143 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:17.714853 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-dcb6ec24-9246-4fa6-94b8-68329606c143 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:17.715545 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-dcb6ec24-9246-4fa6-94b8-68329606c143 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:17.716211 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-dcb6ec24-9246-4fa6-94b8-68329606c143 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:17.716693 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-dcb6ec24-9246-4fa6-94b8-68329606c143 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:17.847113 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-dcb6ec24-9246-4fa6-94b8-68329606c143 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:17.855034 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-dcb6ec24-9246-4fa6-94b8-68329606c143 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:17.856641 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-dcb6ec24-9246-4fa6-94b8-68329606c143 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:17.857752 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-dcb6ec24-9246-4fa6-94b8-68329606c143 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1723 microversion: 2.20 time: 0.154677 Aug 10 11:38:17.858311 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 315/632] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:38:17 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:38:18.880299 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-a2a58f20-dbf7-49ab-acd1-a9a4d66e6a70 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:38:18.880913 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-a2a58f20-dbf7-49ab-acd1-a9a4d66e6a70 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:18.887181 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a2a58f20-dbf7-49ab-acd1-a9a4d66e6a70 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:18.887665 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a2a58f20-dbf7-49ab-acd1-a9a4d66e6a70 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:18.888129 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a2a58f20-dbf7-49ab-acd1-a9a4d66e6a70 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:18.888921 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a2a58f20-dbf7-49ab-acd1-a9a4d66e6a70 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:18.888921 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a2a58f20-dbf7-49ab-acd1-a9a4d66e6a70 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:18.889679 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a2a58f20-dbf7-49ab-acd1-a9a4d66e6a70 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:19.021893 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-a2a58f20-dbf7-49ab-acd1-a9a4d66e6a70 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:19.030360 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-a2a58f20-dbf7-49ab-acd1-a9a4d66e6a70 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:19.032090 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-a2a58f20-dbf7-49ab-acd1-a9a4d66e6a70 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:19.038893 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-a2a58f20-dbf7-49ab-acd1-a9a4d66e6a70 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1723 microversion: 2.20 time: 0.156909 Aug 10 11:38:19.038893 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 318/633] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:38:18 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:38:20.058584 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-63e3b164-a1bb-434e-9d9d-7218ca2f9082 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:38:20.059374 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-63e3b164-a1bb-434e-9d9d-7218ca2f9082 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:20.062952 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:38:20.067590 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-63e3b164-a1bb-434e-9d9d-7218ca2f9082 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:20.068116 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-63e3b164-a1bb-434e-9d9d-7218ca2f9082 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:20.068557 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-63e3b164-a1bb-434e-9d9d-7218ca2f9082 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:20.069255 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-63e3b164-a1bb-434e-9d9d-7218ca2f9082 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:20.069821 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-63e3b164-a1bb-434e-9d9d-7218ca2f9082 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:20.070252 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-63e3b164-a1bb-434e-9d9d-7218ca2f9082 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:20.206322 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-63e3b164-a1bb-434e-9d9d-7218ca2f9082 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:20.214251 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-63e3b164-a1bb-434e-9d9d-7218ca2f9082 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:20.217859 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-63e3b164-a1bb-434e-9d9d-7218ca2f9082 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:20.217859 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-63e3b164-a1bb-434e-9d9d-7218ca2f9082 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1723 microversion: 2.20 time: 0.162133 Aug 10 11:38:20.217859 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 316/634] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:38:20 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:38:21.239613 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-a1586b3b-57fb-4b0c-a637-b2e8514f28e9 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:38:21.240252 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-a1586b3b-57fb-4b0c-a637-b2e8514f28e9 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:21.242780 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:38:21.247336 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a1586b3b-57fb-4b0c-a637-b2e8514f28e9 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:21.247841 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a1586b3b-57fb-4b0c-a637-b2e8514f28e9 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:21.248794 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a1586b3b-57fb-4b0c-a637-b2e8514f28e9 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:21.249630 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a1586b3b-57fb-4b0c-a637-b2e8514f28e9 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:21.250084 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a1586b3b-57fb-4b0c-a637-b2e8514f28e9 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:21.250507 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a1586b3b-57fb-4b0c-a637-b2e8514f28e9 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:21.384984 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-a1586b3b-57fb-4b0c-a637-b2e8514f28e9 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:21.393898 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-a1586b3b-57fb-4b0c-a637-b2e8514f28e9 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:21.395375 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-a1586b3b-57fb-4b0c-a637-b2e8514f28e9 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:21.396551 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-a1586b3b-57fb-4b0c-a637-b2e8514f28e9 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1723 microversion: 2.20 time: 0.160926 Aug 10 11:38:21.397337 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 319/635] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:38:21 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:38:22.420794 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-3d3440a5-0966-4da1-ad7c-8d761d12bb17 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:38:22.421637 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-3d3440a5-0966-4da1-ad7c-8d761d12bb17 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:22.428043 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3d3440a5-0966-4da1-ad7c-8d761d12bb17 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:22.428528 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3d3440a5-0966-4da1-ad7c-8d761d12bb17 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:22.428946 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3d3440a5-0966-4da1-ad7c-8d761d12bb17 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:22.429627 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3d3440a5-0966-4da1-ad7c-8d761d12bb17 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:22.430076 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3d3440a5-0966-4da1-ad7c-8d761d12bb17 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:22.430495 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3d3440a5-0966-4da1-ad7c-8d761d12bb17 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:22.561308 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-3d3440a5-0966-4da1-ad7c-8d761d12bb17 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:22.569674 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-3d3440a5-0966-4da1-ad7c-8d761d12bb17 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:22.571188 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-3d3440a5-0966-4da1-ad7c-8d761d12bb17 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:22.572376 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-3d3440a5-0966-4da1-ad7c-8d761d12bb17 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1723 microversion: 2.20 time: 0.156480 Aug 10 11:38:22.572953 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 317/636] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:38:22 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:38:23.595390 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-fcc36205-672c-426e-8e76-85064ce2b56f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:38:23.596039 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-fcc36205-672c-426e-8e76-85064ce2b56f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:23.603043 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fcc36205-672c-426e-8e76-85064ce2b56f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:23.603533 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fcc36205-672c-426e-8e76-85064ce2b56f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:23.603983 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fcc36205-672c-426e-8e76-85064ce2b56f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:23.604707 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fcc36205-672c-426e-8e76-85064ce2b56f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:23.605164 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fcc36205-672c-426e-8e76-85064ce2b56f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:23.605626 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fcc36205-672c-426e-8e76-85064ce2b56f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:23.739106 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-fcc36205-672c-426e-8e76-85064ce2b56f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:23.746929 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-fcc36205-672c-426e-8e76-85064ce2b56f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:23.748669 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-fcc36205-672c-426e-8e76-85064ce2b56f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:23.749811 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-fcc36205-672c-426e-8e76-85064ce2b56f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1723 microversion: 2.20 time: 0.159067 Aug 10 11:38:23.750360 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 320/637] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:38:23 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:38:24.772692 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-fc4a43d5-39f1-48c7-a176-f3762f0321c8 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:38:24.773308 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-fc4a43d5-39f1-48c7-a176-f3762f0321c8 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:24.780463 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fc4a43d5-39f1-48c7-a176-f3762f0321c8 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:24.780953 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fc4a43d5-39f1-48c7-a176-f3762f0321c8 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:24.781394 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fc4a43d5-39f1-48c7-a176-f3762f0321c8 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:24.782090 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fc4a43d5-39f1-48c7-a176-f3762f0321c8 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:24.782548 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fc4a43d5-39f1-48c7-a176-f3762f0321c8 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:24.782976 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fc4a43d5-39f1-48c7-a176-f3762f0321c8 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:24.913202 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-fc4a43d5-39f1-48c7-a176-f3762f0321c8 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:24.921025 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-fc4a43d5-39f1-48c7-a176-f3762f0321c8 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:24.922563 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-fc4a43d5-39f1-48c7-a176-f3762f0321c8 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:24.923723 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-fc4a43d5-39f1-48c7-a176-f3762f0321c8 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1723 microversion: 2.20 time: 0.154936 Aug 10 11:38:24.924327 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 318/638] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:38:24 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:38:25.945885 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-8d017349-e352-43ec-9bd4-bc4c4d8cd10e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:38:25.946499 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-8d017349-e352-43ec-9bd4-bc4c4d8cd10e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:25.953693 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8d017349-e352-43ec-9bd4-bc4c4d8cd10e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:25.954175 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8d017349-e352-43ec-9bd4-bc4c4d8cd10e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:25.954609 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8d017349-e352-43ec-9bd4-bc4c4d8cd10e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:25.955327 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8d017349-e352-43ec-9bd4-bc4c4d8cd10e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:25.955779 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8d017349-e352-43ec-9bd4-bc4c4d8cd10e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:25.956233 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8d017349-e352-43ec-9bd4-bc4c4d8cd10e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:25.958704 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=70 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:38:26.090684 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-8d017349-e352-43ec-9bd4-bc4c4d8cd10e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:26.100048 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-8d017349-e352-43ec-9bd4-bc4c4d8cd10e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:26.101975 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-8d017349-e352-43ec-9bd4-bc4c4d8cd10e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:26.103139 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-8d017349-e352-43ec-9bd4-bc4c4d8cd10e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1723 microversion: 2.20 time: 0.161125 Aug 10 11:38:26.103702 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 321/639] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:38:25 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:38:27.125886 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-222fe09e-0b0f-4ebd-83f5-70a96289c131 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:38:27.126477 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-222fe09e-0b0f-4ebd-83f5-70a96289c131 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:27.132858 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-222fe09e-0b0f-4ebd-83f5-70a96289c131 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:27.133344 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-222fe09e-0b0f-4ebd-83f5-70a96289c131 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:27.133803 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-222fe09e-0b0f-4ebd-83f5-70a96289c131 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:27.134486 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-222fe09e-0b0f-4ebd-83f5-70a96289c131 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:27.134937 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-222fe09e-0b0f-4ebd-83f5-70a96289c131 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:27.135357 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-222fe09e-0b0f-4ebd-83f5-70a96289c131 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:27.261067 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-222fe09e-0b0f-4ebd-83f5-70a96289c131 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:27.270537 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-222fe09e-0b0f-4ebd-83f5-70a96289c131 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:27.272055 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-222fe09e-0b0f-4ebd-83f5-70a96289c131 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:27.273204 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-222fe09e-0b0f-4ebd-83f5-70a96289c131 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1723 microversion: 2.20 time: 0.151413 Aug 10 11:38:27.273755 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 319/640] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:38:27 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:38:28.296310 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-48eb5296-90a7-4a5e-b93c-9fe3f48a89a7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:38:28.296993 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-48eb5296-90a7-4a5e-b93c-9fe3f48a89a7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:28.303439 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-48eb5296-90a7-4a5e-b93c-9fe3f48a89a7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:28.303920 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-48eb5296-90a7-4a5e-b93c-9fe3f48a89a7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:28.304378 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-48eb5296-90a7-4a5e-b93c-9fe3f48a89a7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:28.305053 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-48eb5296-90a7-4a5e-b93c-9fe3f48a89a7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:28.305498 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-48eb5296-90a7-4a5e-b93c-9fe3f48a89a7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:28.305917 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-48eb5296-90a7-4a5e-b93c-9fe3f48a89a7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:28.436520 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-48eb5296-90a7-4a5e-b93c-9fe3f48a89a7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:28.444555 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-48eb5296-90a7-4a5e-b93c-9fe3f48a89a7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:28.446062 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-48eb5296-90a7-4a5e-b93c-9fe3f48a89a7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:28.447200 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-48eb5296-90a7-4a5e-b93c-9fe3f48a89a7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1723 microversion: 2.20 time: 0.155745 Aug 10 11:38:28.447755 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 322/641] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:38:28 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:38:29.469874 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-20cc5920-4f53-49f1-bf9b-009145c661ac tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:38:29.470418 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-20cc5920-4f53-49f1-bf9b-009145c661ac tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:29.476484 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-20cc5920-4f53-49f1-bf9b-009145c661ac tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:29.476967 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-20cc5920-4f53-49f1-bf9b-009145c661ac tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:29.477403 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-20cc5920-4f53-49f1-bf9b-009145c661ac tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:29.478092 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-20cc5920-4f53-49f1-bf9b-009145c661ac tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:29.478542 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-20cc5920-4f53-49f1-bf9b-009145c661ac tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:29.478965 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-20cc5920-4f53-49f1-bf9b-009145c661ac tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:29.605488 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-20cc5920-4f53-49f1-bf9b-009145c661ac tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:29.613529 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-20cc5920-4f53-49f1-bf9b-009145c661ac tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:29.615035 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-20cc5920-4f53-49f1-bf9b-009145c661ac tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:29.616234 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-20cc5920-4f53-49f1-bf9b-009145c661ac tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1744 microversion: 2.20 time: 0.150331 Aug 10 11:38:29.616784 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 320/642] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:38:29 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1744 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:38:30.638714 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-fc3d7732-ada1-455e-ba1c-ef71063e6897 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:38:30.639344 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-fc3d7732-ada1-455e-ba1c-ef71063e6897 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:30.646176 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fc3d7732-ada1-455e-ba1c-ef71063e6897 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:30.646661 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fc3d7732-ada1-455e-ba1c-ef71063e6897 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:30.647104 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fc3d7732-ada1-455e-ba1c-ef71063e6897 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:30.647792 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fc3d7732-ada1-455e-ba1c-ef71063e6897 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:30.648286 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fc3d7732-ada1-455e-ba1c-ef71063e6897 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:30.648719 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fc3d7732-ada1-455e-ba1c-ef71063e6897 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:30.776539 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-fc3d7732-ada1-455e-ba1c-ef71063e6897 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:30.785064 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-fc3d7732-ada1-455e-ba1c-ef71063e6897 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:30.786569 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-fc3d7732-ada1-455e-ba1c-ef71063e6897 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:30.787731 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-fc3d7732-ada1-455e-ba1c-ef71063e6897 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1744 microversion: 2.20 time: 0.153048 Aug 10 11:38:30.788336 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 323/643] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:38:30 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:38:31.810449 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-f42e2d37-7d7a-40e3-a95d-263ce2b6fee5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:38:31.811118 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-f42e2d37-7d7a-40e3-a95d-263ce2b6fee5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:31.817680 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f42e2d37-7d7a-40e3-a95d-263ce2b6fee5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:31.818164 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f42e2d37-7d7a-40e3-a95d-263ce2b6fee5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:31.818628 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f42e2d37-7d7a-40e3-a95d-263ce2b6fee5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:31.819317 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f42e2d37-7d7a-40e3-a95d-263ce2b6fee5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:31.819772 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f42e2d37-7d7a-40e3-a95d-263ce2b6fee5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:31.820223 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f42e2d37-7d7a-40e3-a95d-263ce2b6fee5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:31.948554 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-f42e2d37-7d7a-40e3-a95d-263ce2b6fee5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:31.956496 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-f42e2d37-7d7a-40e3-a95d-263ce2b6fee5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:31.957995 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-f42e2d37-7d7a-40e3-a95d-263ce2b6fee5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:31.959146 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-f42e2d37-7d7a-40e3-a95d-263ce2b6fee5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1744 microversion: 2.20 time: 0.152735 Aug 10 11:38:31.959707 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 321/644] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:38:31 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:38:32.458782 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-e13daa26-ff3b-49e1-911d-4ffd29bff697 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:38:32.459270 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-e13daa26-ff3b-49e1-911d-4ffd29bff697 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: ae770112-a153-4fc8-97ea-637cd10d7024] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:32.465727 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e13daa26-ff3b-49e1-911d-4ffd29bff697 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:32.466211 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e13daa26-ff3b-49e1-911d-4ffd29bff697 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:32.466795 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e13daa26-ff3b-49e1-911d-4ffd29bff697 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:32.467481 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e13daa26-ff3b-49e1-911d-4ffd29bff697 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:32.467936 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e13daa26-ff3b-49e1-911d-4ffd29bff697 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:32.468383 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e13daa26-ff3b-49e1-911d-4ffd29bff697 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:32.490359 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-e13daa26-ff3b-49e1-911d-4ffd29bff697 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024/ips" status: 200 len: 145 microversion: 2.1 time: 0.035449 Aug 10 11:38:32.490925 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 324/645] 10.222.0.62 () {58 vars in 1248 bytes} [Wed Aug 10 11:38:32 2022] GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024/ips => generated 145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:38:33.000055 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-320e16e9-1ef9-406b-800b-4e964290e885 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:38:33.000055 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-320e16e9-1ef9-406b-800b-4e964290e885 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:33.003271 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-320e16e9-1ef9-406b-800b-4e964290e885 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:33.003997 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-320e16e9-1ef9-406b-800b-4e964290e885 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:33.004592 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-320e16e9-1ef9-406b-800b-4e964290e885 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:33.007626 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-320e16e9-1ef9-406b-800b-4e964290e885 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:33.008287 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-320e16e9-1ef9-406b-800b-4e964290e885 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:33.010620 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-320e16e9-1ef9-406b-800b-4e964290e885 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:33.027715 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:38:33.158945 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-320e16e9-1ef9-406b-800b-4e964290e885 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:33.167585 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-320e16e9-1ef9-406b-800b-4e964290e885 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:33.170843 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-320e16e9-1ef9-406b-800b-4e964290e885 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:33.172231 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-320e16e9-1ef9-406b-800b-4e964290e885 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1744 microversion: 2.20 time: 0.193674 Aug 10 11:38:33.183680 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 322/646] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:38:32 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1744 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:38:34.194585 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-bd63a4d2-c0fd-4d5f-8e07-78bd3a6719a4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:38:34.196844 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-bd63a4d2-c0fd-4d5f-8e07-78bd3a6719a4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:34.202227 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bd63a4d2-c0fd-4d5f-8e07-78bd3a6719a4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:34.202695 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bd63a4d2-c0fd-4d5f-8e07-78bd3a6719a4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:34.203130 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bd63a4d2-c0fd-4d5f-8e07-78bd3a6719a4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:34.203807 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bd63a4d2-c0fd-4d5f-8e07-78bd3a6719a4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:34.204293 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bd63a4d2-c0fd-4d5f-8e07-78bd3a6719a4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:34.204712 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bd63a4d2-c0fd-4d5f-8e07-78bd3a6719a4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:34.340710 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-bd63a4d2-c0fd-4d5f-8e07-78bd3a6719a4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:34.348853 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-bd63a4d2-c0fd-4d5f-8e07-78bd3a6719a4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:34.351481 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-bd63a4d2-c0fd-4d5f-8e07-78bd3a6719a4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:34.351481 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-bd63a4d2-c0fd-4d5f-8e07-78bd3a6719a4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1744 microversion: 2.20 time: 0.160795 Aug 10 11:38:34.352125 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 325/647] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:38:34 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:38:35.186204 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-0906fe3e-2632-48dc-8cdc-a2d48c087356 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d5967f5-1d06-4890-b4b0-87a60f4fe8ef"}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:38:35.189852 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-0906fe3e-2632-48dc-8cdc-a2d48c087356 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: ae770112-a153-4fc8-97ea-637cd10d7024] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:35.199661 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0906fe3e-2632-48dc-8cdc-a2d48c087356 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:35.200200 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0906fe3e-2632-48dc-8cdc-a2d48c087356 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:35.200679 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0906fe3e-2632-48dc-8cdc-a2d48c087356 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:35.201400 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0906fe3e-2632-48dc-8cdc-a2d48c087356 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:35.201960 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0906fe3e-2632-48dc-8cdc-a2d48c087356 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:35.202396 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0906fe3e-2632-48dc-8cdc-a2d48c087356 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:35.375618 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-0e5ab31a-0047-4984-832d-80aa07705356 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:38:35.376325 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-0e5ab31a-0047-4984-832d-80aa07705356 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:35.383070 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0e5ab31a-0047-4984-832d-80aa07705356 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:35.384040 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0e5ab31a-0047-4984-832d-80aa07705356 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:35.384682 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0e5ab31a-0047-4984-832d-80aa07705356 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:35.385500 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0e5ab31a-0047-4984-832d-80aa07705356 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:35.386228 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0e5ab31a-0047-4984-832d-80aa07705356 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:35.386858 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0e5ab31a-0047-4984-832d-80aa07705356 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:35.539439 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-0e5ab31a-0047-4984-832d-80aa07705356 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:35.548650 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-0e5ab31a-0047-4984-832d-80aa07705356 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:35.550157 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-0e5ab31a-0047-4984-832d-80aa07705356 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:35.551314 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-0e5ab31a-0047-4984-832d-80aa07705356 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1739 microversion: 2.20 time: 0.180369 Aug 10 11:38:35.551869 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 326/648] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:38:35 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:38:36.057867 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-0906fe3e-2632-48dc-8cdc-a2d48c087356 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "POST /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.876944 Aug 10 11:38:36.059444 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 323/649] 10.222.0.62 () {60 vars in 1323 bytes} [Wed Aug 10 11:38:35 2022] POST /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024/os-volume_attachments => generated 194 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:38:36.219671 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-b471c507-fe2e-434d-82df-f0eaae51ddc8 req-e7e27934-38d6-457d-aef3-97dfebeef362 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "865edaf1-a2d9-492e-af4c-05e5aecd6cf8", "name": "network-vif-plugged", "status": "completed", "tag": "61acbadb-ed19-49d1-a43f-0e58327b568a"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:38:36.230171 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-b471c507-fe2e-434d-82df-f0eaae51ddc8 req-e7e27934-38d6-457d-aef3-97dfebeef362 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:36.230693 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-b471c507-fe2e-434d-82df-f0eaae51ddc8 req-e7e27934-38d6-457d-aef3-97dfebeef362 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:36.231262 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-b471c507-fe2e-434d-82df-f0eaae51ddc8 req-e7e27934-38d6-457d-aef3-97dfebeef362 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:36.247250 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-b471c507-fe2e-434d-82df-f0eaae51ddc8 req-e7e27934-38d6-457d-aef3-97dfebeef362 service nova] Creating event network-vif-plugged:61acbadb-ed19-49d1-a43f-0e58327b568a for instance 865edaf1-a2d9-492e-af4c-05e5aecd6cf8 on hv-cinder-85272 Aug 10 11:38:36.252891 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-b471c507-fe2e-434d-82df-f0eaae51ddc8 req-e7e27934-38d6-457d-aef3-97dfebeef362 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.276435 Aug 10 11:38:36.253481 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 327/650] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:38:36.579083 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-7532fc4b-2007-43d3-a4aa-c39c560d5a8a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:38:36.579704 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-7532fc4b-2007-43d3-a4aa-c39c560d5a8a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:36.588283 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7532fc4b-2007-43d3-a4aa-c39c560d5a8a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:36.588857 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7532fc4b-2007-43d3-a4aa-c39c560d5a8a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:36.589555 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7532fc4b-2007-43d3-a4aa-c39c560d5a8a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:36.590652 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7532fc4b-2007-43d3-a4aa-c39c560d5a8a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:36.591472 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7532fc4b-2007-43d3-a4aa-c39c560d5a8a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:36.591993 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7532fc4b-2007-43d3-a4aa-c39c560d5a8a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:36.741509 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-7532fc4b-2007-43d3-a4aa-c39c560d5a8a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:36.752658 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-7532fc4b-2007-43d3-a4aa-c39c560d5a8a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:36.754331 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-7532fc4b-2007-43d3-a4aa-c39c560d5a8a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:36.755835 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-7532fc4b-2007-43d3-a4aa-c39c560d5a8a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1739 microversion: 2.20 time: 0.181730 Aug 10 11:38:36.756881 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 324/651] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:38:36 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:38:37.782356 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-2db3dce8-3fca-43f0-a855-152da91206a0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:38:37.783184 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-2db3dce8-3fca-43f0-a855-152da91206a0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:37.791293 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2db3dce8-3fca-43f0-a855-152da91206a0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:37.792143 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2db3dce8-3fca-43f0-a855-152da91206a0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:37.792661 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2db3dce8-3fca-43f0-a855-152da91206a0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:37.793523 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2db3dce8-3fca-43f0-a855-152da91206a0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:37.794058 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2db3dce8-3fca-43f0-a855-152da91206a0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:37.795078 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2db3dce8-3fca-43f0-a855-152da91206a0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:37.934381 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-2db3dce8-3fca-43f0-a855-152da91206a0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:37.943131 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-2db3dce8-3fca-43f0-a855-152da91206a0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:37.944657 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-2db3dce8-3fca-43f0-a855-152da91206a0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:37.945834 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-2db3dce8-3fca-43f0-a855-152da91206a0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1739 microversion: 2.20 time: 0.169128 Aug 10 11:38:37.952637 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 328/652] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:38:37 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1739 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:38:38.973399 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-fab1555b-526c-4345-936e-b241d23cb343 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:38:38.974146 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-fab1555b-526c-4345-936e-b241d23cb343 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:38.990320 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fab1555b-526c-4345-936e-b241d23cb343 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:38.991316 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fab1555b-526c-4345-936e-b241d23cb343 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:38.991768 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fab1555b-526c-4345-936e-b241d23cb343 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:38.992687 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fab1555b-526c-4345-936e-b241d23cb343 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:38.993317 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fab1555b-526c-4345-936e-b241d23cb343 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:38.993648 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fab1555b-526c-4345-936e-b241d23cb343 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:39.152379 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-fab1555b-526c-4345-936e-b241d23cb343 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:39.162056 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-fab1555b-526c-4345-936e-b241d23cb343 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:39.165709 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-fab1555b-526c-4345-936e-b241d23cb343 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:39.167088 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-fab1555b-526c-4345-936e-b241d23cb343 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1739 microversion: 2.20 time: 0.197561 Aug 10 11:38:39.167764 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 325/653] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:38:38 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1739 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:38:40.193890 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-31e9ae22-3878-4115-87c2-6261445b2e1f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:38:40.194534 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-31e9ae22-3878-4115-87c2-6261445b2e1f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:40.205049 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-31e9ae22-3878-4115-87c2-6261445b2e1f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:40.206615 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-31e9ae22-3878-4115-87c2-6261445b2e1f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:40.207468 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-31e9ae22-3878-4115-87c2-6261445b2e1f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:40.209077 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-31e9ae22-3878-4115-87c2-6261445b2e1f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:40.209767 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-31e9ae22-3878-4115-87c2-6261445b2e1f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:40.210259 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-31e9ae22-3878-4115-87c2-6261445b2e1f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:40.395370 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-31e9ae22-3878-4115-87c2-6261445b2e1f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:40.410213 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-31e9ae22-3878-4115-87c2-6261445b2e1f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:40.412200 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-31e9ae22-3878-4115-87c2-6261445b2e1f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:40.413344 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-31e9ae22-3878-4115-87c2-6261445b2e1f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1739 microversion: 2.20 time: 0.223509 Aug 10 11:38:40.414441 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 329/654] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:38:40 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1739 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:38:41.439899 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-f046ad7f-de88-4352-a593-323b79caaf57 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:38:41.441258 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-f046ad7f-de88-4352-a593-323b79caaf57 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:41.457441 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f046ad7f-de88-4352-a593-323b79caaf57 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:41.457946 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f046ad7f-de88-4352-a593-323b79caaf57 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:41.458981 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f046ad7f-de88-4352-a593-323b79caaf57 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:41.460194 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f046ad7f-de88-4352-a593-323b79caaf57 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:41.460989 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f046ad7f-de88-4352-a593-323b79caaf57 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:41.461587 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f046ad7f-de88-4352-a593-323b79caaf57 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:41.630734 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-f046ad7f-de88-4352-a593-323b79caaf57 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:41.644866 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-f046ad7f-de88-4352-a593-323b79caaf57 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:41.646705 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-f046ad7f-de88-4352-a593-323b79caaf57 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:41.648105 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-f046ad7f-de88-4352-a593-323b79caaf57 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1739 microversion: 2.20 time: 0.213212 Aug 10 11:38:41.649018 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 326/655] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:38:41 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1739 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:38:42.673275 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-e83a7783-f973-4aef-9cd0-7414635f7057 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:38:42.673874 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-e83a7783-f973-4aef-9cd0-7414635f7057 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:42.682742 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e83a7783-f973-4aef-9cd0-7414635f7057 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:42.683477 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e83a7783-f973-4aef-9cd0-7414635f7057 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:42.683912 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e83a7783-f973-4aef-9cd0-7414635f7057 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:42.684761 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e83a7783-f973-4aef-9cd0-7414635f7057 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:42.686094 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e83a7783-f973-4aef-9cd0-7414635f7057 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:42.691018 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e83a7783-f973-4aef-9cd0-7414635f7057 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:42.862317 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-e83a7783-f973-4aef-9cd0-7414635f7057 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:42.875532 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-e83a7783-f973-4aef-9cd0-7414635f7057 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:42.877285 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-e83a7783-f973-4aef-9cd0-7414635f7057 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:42.878709 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-e83a7783-f973-4aef-9cd0-7414635f7057 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1739 microversion: 2.20 time: 0.211892 Aug 10 11:38:42.879368 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 330/656] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:38:42 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1739 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:38:43.720653 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-5a8625c8-4c5d-4f49-bfdd-e25c724ed4d1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:38:43.723176 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-5a8625c8-4c5d-4f49-bfdd-e25c724ed4d1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: ae770112-a153-4fc8-97ea-637cd10d7024] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:43.729821 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5a8625c8-4c5d-4f49-bfdd-e25c724ed4d1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:43.730503 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5a8625c8-4c5d-4f49-bfdd-e25c724ed4d1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:43.730940 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5a8625c8-4c5d-4f49-bfdd-e25c724ed4d1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:43.732401 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5a8625c8-4c5d-4f49-bfdd-e25c724ed4d1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:43.732850 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5a8625c8-4c5d-4f49-bfdd-e25c724ed4d1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:43.733278 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5a8625c8-4c5d-4f49-bfdd-e25c724ed4d1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:43.767377 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-5a8625c8-4c5d-4f49-bfdd-e25c724ed4d1 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052660 Aug 10 11:38:43.768323 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 327/657] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 10 11:38:43 2022] GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:38:43.778881 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-a5192b5a-3635-4742-af86-180e47c95963 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:38:43.779470 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-a5192b5a-3635-4742-af86-180e47c95963 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: ae770112-a153-4fc8-97ea-637cd10d7024] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:43.786962 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a5192b5a-3635-4742-af86-180e47c95963 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:43.787447 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a5192b5a-3635-4742-af86-180e47c95963 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:43.787881 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a5192b5a-3635-4742-af86-180e47c95963 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:43.788625 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a5192b5a-3635-4742-af86-180e47c95963 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:43.789073 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a5192b5a-3635-4742-af86-180e47c95963 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:43.789671 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a5192b5a-3635-4742-af86-180e47c95963 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:43.823431 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-a5192b5a-3635-4742-af86-180e47c95963 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024/os-volume_attachments/8d5967f5-1d06-4890-b4b0-87a60f4fe8ef" status: 200 len: 194 microversion: 2.1 time: 0.048862 Aug 10 11:38:43.824083 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 331/658] 10.222.0.62 () {58 vars in 1413 bytes} [Wed Aug 10 11:38:43 2022] GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024/os-volume_attachments/8d5967f5-1d06-4890-b4b0-87a60f4fe8ef => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:38:43.905346 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-877b2273-cb74-4274-aadd-31bedb47fcac tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:38:43.906288 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-877b2273-cb74-4274-aadd-31bedb47fcac tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:43.913591 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-877b2273-cb74-4274-aadd-31bedb47fcac tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:43.914087 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-877b2273-cb74-4274-aadd-31bedb47fcac tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:43.914532 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-877b2273-cb74-4274-aadd-31bedb47fcac tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:43.915241 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-877b2273-cb74-4274-aadd-31bedb47fcac tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:43.915701 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-877b2273-cb74-4274-aadd-31bedb47fcac tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:43.916158 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-877b2273-cb74-4274-aadd-31bedb47fcac tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:44.073148 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-877b2273-cb74-4274-aadd-31bedb47fcac tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:44.081410 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-877b2273-cb74-4274-aadd-31bedb47fcac tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:44.083096 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-877b2273-cb74-4274-aadd-31bedb47fcac tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:44.084220 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-877b2273-cb74-4274-aadd-31bedb47fcac tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1739 microversion: 2.20 time: 0.183407 Aug 10 11:38:44.084783 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 328/659] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:38:43 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1739 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:38:45.108756 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-9fd91b99-2a6b-4819-a1df-61e1f7395c28 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:38:45.109582 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-9fd91b99-2a6b-4819-a1df-61e1f7395c28 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:45.116227 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9fd91b99-2a6b-4819-a1df-61e1f7395c28 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:45.116707 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9fd91b99-2a6b-4819-a1df-61e1f7395c28 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:45.117139 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9fd91b99-2a6b-4819-a1df-61e1f7395c28 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:45.117830 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9fd91b99-2a6b-4819-a1df-61e1f7395c28 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:45.118279 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9fd91b99-2a6b-4819-a1df-61e1f7395c28 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:45.118779 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9fd91b99-2a6b-4819-a1df-61e1f7395c28 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:45.256145 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-9fd91b99-2a6b-4819-a1df-61e1f7395c28 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:45.264963 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-9fd91b99-2a6b-4819-a1df-61e1f7395c28 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:45.266732 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-9fd91b99-2a6b-4819-a1df-61e1f7395c28 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:45.267879 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-9fd91b99-2a6b-4819-a1df-61e1f7395c28 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1739 microversion: 2.20 time: 0.164099 Aug 10 11:38:45.268463 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 332/660] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:38:45 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1739 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:38:46.290989 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-5b02ab84-be68-4683-b491-28fe715f9545 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:38:46.291606 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-5b02ab84-be68-4683-b491-28fe715f9545 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:46.298186 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5b02ab84-be68-4683-b491-28fe715f9545 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:46.298670 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5b02ab84-be68-4683-b491-28fe715f9545 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:46.299108 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5b02ab84-be68-4683-b491-28fe715f9545 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:46.299850 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5b02ab84-be68-4683-b491-28fe715f9545 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:46.300335 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5b02ab84-be68-4683-b491-28fe715f9545 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:46.300762 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5b02ab84-be68-4683-b491-28fe715f9545 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:46.432535 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-5b02ab84-be68-4683-b491-28fe715f9545 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:46.441106 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-5b02ab84-be68-4683-b491-28fe715f9545 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:46.442589 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-5b02ab84-be68-4683-b491-28fe715f9545 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:46.443749 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-5b02ab84-be68-4683-b491-28fe715f9545 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1721 microversion: 2.20 time: 0.156657 Aug 10 11:38:46.444348 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 329/661] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:38:46 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:38:46.693140 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-ed95d075-cc77-432e-82f4-6a27d13fed98 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c42527d2-82a2-4544-a269-3d45b2dac9b4"}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:38:46.695490 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-ed95d075-cc77-432e-82f4-6a27d13fed98 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: ae770112-a153-4fc8-97ea-637cd10d7024] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:46.702575 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ed95d075-cc77-432e-82f4-6a27d13fed98 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:46.703058 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ed95d075-cc77-432e-82f4-6a27d13fed98 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:46.703582 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ed95d075-cc77-432e-82f4-6a27d13fed98 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:46.704499 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ed95d075-cc77-432e-82f4-6a27d13fed98 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:46.704956 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ed95d075-cc77-432e-82f4-6a27d13fed98 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:46.705383 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ed95d075-cc77-432e-82f4-6a27d13fed98 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:47.459790 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-ed95d075-cc77-432e-82f4-6a27d13fed98 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "POST /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.770615 Aug 10 11:38:47.460459 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 333/662] 10.222.0.62 () {60 vars in 1323 bytes} [Wed Aug 10 11:38:46 2022] POST /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024/os-volume_attachments => generated 194 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:38:47.468067 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-a2bcd255-0ac4-4375-b928-439ab6c3dcba tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:38:47.468643 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-a2bcd255-0ac4-4375-b928-439ab6c3dcba tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:47.475301 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a2bcd255-0ac4-4375-b928-439ab6c3dcba tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:47.475793 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a2bcd255-0ac4-4375-b928-439ab6c3dcba tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:47.476255 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a2bcd255-0ac4-4375-b928-439ab6c3dcba tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:47.476957 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a2bcd255-0ac4-4375-b928-439ab6c3dcba tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:47.477416 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a2bcd255-0ac4-4375-b928-439ab6c3dcba tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:47.477848 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a2bcd255-0ac4-4375-b928-439ab6c3dcba tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:47.611492 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-a2bcd255-0ac4-4375-b928-439ab6c3dcba tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:47.619431 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-a2bcd255-0ac4-4375-b928-439ab6c3dcba tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:47.620940 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-a2bcd255-0ac4-4375-b928-439ab6c3dcba tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:47.622075 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-a2bcd255-0ac4-4375-b928-439ab6c3dcba tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1721 microversion: 2.20 time: 0.158598 Aug 10 11:38:47.622629 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 330/663] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:38:47 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:38:48.645742 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-68ad2e9e-26d0-45b0-9d25-7a5c06c76ef6 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:38:48.646443 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-68ad2e9e-26d0-45b0-9d25-7a5c06c76ef6 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:48.663486 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-68ad2e9e-26d0-45b0-9d25-7a5c06c76ef6 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:48.664002 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-68ad2e9e-26d0-45b0-9d25-7a5c06c76ef6 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:48.664440 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-68ad2e9e-26d0-45b0-9d25-7a5c06c76ef6 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:48.665337 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-68ad2e9e-26d0-45b0-9d25-7a5c06c76ef6 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:48.665778 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-68ad2e9e-26d0-45b0-9d25-7a5c06c76ef6 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:48.666203 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-68ad2e9e-26d0-45b0-9d25-7a5c06c76ef6 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:48.829562 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-68ad2e9e-26d0-45b0-9d25-7a5c06c76ef6 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:48.837808 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-68ad2e9e-26d0-45b0-9d25-7a5c06c76ef6 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:48.842911 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-68ad2e9e-26d0-45b0-9d25-7a5c06c76ef6 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:48.842911 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-68ad2e9e-26d0-45b0-9d25-7a5c06c76ef6 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1721 microversion: 2.20 time: 0.199497 Aug 10 11:38:48.842911 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 334/664] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:38:48 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1721 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:38:49.863125 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-d7fa581b-4b5a-4135-8fdf-8780b4e3e9b5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:38:49.863684 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-d7fa581b-4b5a-4135-8fdf-8780b4e3e9b5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:49.870203 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d7fa581b-4b5a-4135-8fdf-8780b4e3e9b5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:49.870679 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d7fa581b-4b5a-4135-8fdf-8780b4e3e9b5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:49.871113 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d7fa581b-4b5a-4135-8fdf-8780b4e3e9b5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:49.871790 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d7fa581b-4b5a-4135-8fdf-8780b4e3e9b5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:49.872278 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d7fa581b-4b5a-4135-8fdf-8780b4e3e9b5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:49.873183 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d7fa581b-4b5a-4135-8fdf-8780b4e3e9b5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:50.010556 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-d7fa581b-4b5a-4135-8fdf-8780b4e3e9b5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:50.020559 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-d7fa581b-4b5a-4135-8fdf-8780b4e3e9b5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:50.022079 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-d7fa581b-4b5a-4135-8fdf-8780b4e3e9b5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:50.023227 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-d7fa581b-4b5a-4135-8fdf-8780b4e3e9b5 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1724 microversion: 2.20 time: 0.164016 Aug 10 11:38:50.023787 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 331/665] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:38:49 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:38:50.046399 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-d2d2a255-729f-4a4f-8890-3c3863ab18a0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1eed3cf0-eeff-405e-860c-cf904d015d84"}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:38:50.048928 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-d2d2a255-729f-4a4f-8890-3c3863ab18a0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:50.055375 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d2d2a255-729f-4a4f-8890-3c3863ab18a0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:50.055859 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d2d2a255-729f-4a4f-8890-3c3863ab18a0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:50.056362 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d2d2a255-729f-4a4f-8890-3c3863ab18a0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:50.057059 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d2d2a255-729f-4a4f-8890-3c3863ab18a0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:50.057518 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d2d2a255-729f-4a4f-8890-3c3863ab18a0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:50.057949 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d2d2a255-729f-4a4f-8890-3c3863ab18a0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:50.615901 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:38:50.781760 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-b0d543e1-f4c4-4ca0-a861-a809e090cf16 req-8e1ff72c-1d2c-4373-81e0-bf549352ed37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "865edaf1-a2d9-492e-af4c-05e5aecd6cf8", "name": "network-vif-unplugged", "status": "completed", "tag": "61acbadb-ed19-49d1-a43f-0e58327b568a"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:38:50.786704 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=32 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:38:50.792240 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-b0d543e1-f4c4-4ca0-a861-a809e090cf16 req-8e1ff72c-1d2c-4373-81e0-bf549352ed37 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:50.792832 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-b0d543e1-f4c4-4ca0-a861-a809e090cf16 req-8e1ff72c-1d2c-4373-81e0-bf549352ed37 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:50.793226 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-b0d543e1-f4c4-4ca0-a861-a809e090cf16 req-8e1ff72c-1d2c-4373-81e0-bf549352ed37 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:50.804352 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-b0d543e1-f4c4-4ca0-a861-a809e090cf16 req-8e1ff72c-1d2c-4373-81e0-bf549352ed37 service nova] Creating event network-vif-unplugged:61acbadb-ed19-49d1-a43f-0e58327b568a for instance 865edaf1-a2d9-492e-af4c-05e5aecd6cf8 on hv-cinder-85272 Aug 10 11:38:50.818382 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-b0d543e1-f4c4-4ca0-a861-a809e090cf16 req-8e1ff72c-1d2c-4373-81e0-bf549352ed37 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031982 Aug 10 11:38:50.818382 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 332/666] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:38:51.038038 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-d2d2a255-729f-4a4f-8890-3c3863ab18a0 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "POST /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.996167 Aug 10 11:38:51.038671 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 335/667] 10.222.0.62 () {62 vars in 1364 bytes} [Wed Aug 10 11:38:50 2022] POST /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8/os-volume_attachments => generated 188 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:38:51.161449 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-4f72b844-d0cb-43db-9161-940682c5d21b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:38:51.162029 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-4f72b844-d0cb-43db-9161-940682c5d21b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:51.168466 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4f72b844-d0cb-43db-9161-940682c5d21b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:51.168947 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4f72b844-d0cb-43db-9161-940682c5d21b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:51.169382 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4f72b844-d0cb-43db-9161-940682c5d21b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:51.170226 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4f72b844-d0cb-43db-9161-940682c5d21b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:51.170700 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4f72b844-d0cb-43db-9161-940682c5d21b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:51.171129 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4f72b844-d0cb-43db-9161-940682c5d21b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:51.975680 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-4f72b844-d0cb-43db-9161-940682c5d21b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "DELETE /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8/os-volume_attachments/1eed3cf0-eeff-405e-860c-cf904d015d84" status: 202 len: 0 microversion: 2.20 time: 0.818825 Aug 10 11:38:51.976322 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 333/668] 10.222.0.62 () {60 vars in 1457 bytes} [Wed Aug 10 11:38:51 2022] DELETE /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8/os-volume_attachments/1eed3cf0-eeff-405e-860c-cf904d015d84 => generated 0 bytes in 821 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:38:52.036314 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-e8b72060-9aa0-4179-9ed0-cda63fd41937 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:38:52.036903 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-e8b72060-9aa0-4179-9ed0-cda63fd41937 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:52.044319 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e8b72060-9aa0-4179-9ed0-cda63fd41937 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:52.044802 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e8b72060-9aa0-4179-9ed0-cda63fd41937 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:52.045847 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e8b72060-9aa0-4179-9ed0-cda63fd41937 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:52.046655 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e8b72060-9aa0-4179-9ed0-cda63fd41937 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:52.047152 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e8b72060-9aa0-4179-9ed0-cda63fd41937 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:52.047564 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e8b72060-9aa0-4179-9ed0-cda63fd41937 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:52.076223 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-e8b72060-9aa0-4179-9ed0-cda63fd41937 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124683) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 10 11:38:52.378330 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-e8b72060-9aa0-4179-9ed0-cda63fd41937 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "POST /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8/action" status: 202 len: 0 microversion: 2.20 time: 0.345687 Aug 10 11:38:52.379176 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 336/669] 10.222.0.62 () {62 vars in 1319 bytes} [Wed Aug 10 11:38:52 2022] POST /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8/action => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 10 11:38:52.387191 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-8ec0a3ea-1064-4c31-a1b1-c0bff7eb7c24 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:38:52.387809 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-8ec0a3ea-1064-4c31-a1b1-c0bff7eb7c24 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:52.396808 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8ec0a3ea-1064-4c31-a1b1-c0bff7eb7c24 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:52.397389 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8ec0a3ea-1064-4c31-a1b1-c0bff7eb7c24 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:52.397895 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8ec0a3ea-1064-4c31-a1b1-c0bff7eb7c24 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:52.399268 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8ec0a3ea-1064-4c31-a1b1-c0bff7eb7c24 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:52.399268 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8ec0a3ea-1064-4c31-a1b1-c0bff7eb7c24 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:52.399649 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8ec0a3ea-1064-4c31-a1b1-c0bff7eb7c24 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:52.535562 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-8ec0a3ea-1064-4c31-a1b1-c0bff7eb7c24 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:52.543714 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-8ec0a3ea-1064-4c31-a1b1-c0bff7eb7c24 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:52.546094 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-8ec0a3ea-1064-4c31-a1b1-c0bff7eb7c24 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:52.553226 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-8ec0a3ea-1064-4c31-a1b1-c0bff7eb7c24 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1672 microversion: 2.20 time: 0.164120 Aug 10 11:38:52.553226 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 334/670] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:38:52 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1672 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:38:53.570750 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-c9178c0e-ae96-40bf-a125-e5fd8955b6af tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:38:53.571298 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-c9178c0e-ae96-40bf-a125-e5fd8955b6af tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:53.577779 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c9178c0e-ae96-40bf-a125-e5fd8955b6af tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:53.578260 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c9178c0e-ae96-40bf-a125-e5fd8955b6af tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:53.578694 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c9178c0e-ae96-40bf-a125-e5fd8955b6af tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:53.579403 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c9178c0e-ae96-40bf-a125-e5fd8955b6af tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:53.579856 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c9178c0e-ae96-40bf-a125-e5fd8955b6af tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:53.580310 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c9178c0e-ae96-40bf-a125-e5fd8955b6af tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:53.723596 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-c9178c0e-ae96-40bf-a125-e5fd8955b6af tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:53.731672 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-c9178c0e-ae96-40bf-a125-e5fd8955b6af tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:53.733207 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-c9178c0e-ae96-40bf-a125-e5fd8955b6af tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:53.734888 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-c9178c0e-ae96-40bf-a125-e5fd8955b6af tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1672 microversion: 2.20 time: 0.168185 Aug 10 11:38:53.735452 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 337/671] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:38:53 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1672 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:38:54.758641 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-882fcd69-9a40-4fec-b051-02d97b3810f3 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:38:54.758641 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-882fcd69-9a40-4fec-b051-02d97b3810f3 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:54.765559 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-882fcd69-9a40-4fec-b051-02d97b3810f3 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:54.765916 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-882fcd69-9a40-4fec-b051-02d97b3810f3 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:54.766379 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-882fcd69-9a40-4fec-b051-02d97b3810f3 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:54.767305 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-882fcd69-9a40-4fec-b051-02d97b3810f3 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:54.767777 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-882fcd69-9a40-4fec-b051-02d97b3810f3 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:54.768114 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-882fcd69-9a40-4fec-b051-02d97b3810f3 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:54.787292 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:38:54.992252 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-882fcd69-9a40-4fec-b051-02d97b3810f3 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:54.999140 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-882fcd69-9a40-4fec-b051-02d97b3810f3 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:55.000882 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-882fcd69-9a40-4fec-b051-02d97b3810f3 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:55.002039 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-882fcd69-9a40-4fec-b051-02d97b3810f3 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1730 microversion: 2.20 time: 0.248543 Aug 10 11:38:55.002720 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 335/672] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:38:54 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1730 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:38:56.029580 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-d61fd1c7-6ec0-4f05-8260-f6494a69393e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:38:56.030278 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-d61fd1c7-6ec0-4f05-8260-f6494a69393e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:56.033134 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:38:56.038748 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d61fd1c7-6ec0-4f05-8260-f6494a69393e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:56.039335 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d61fd1c7-6ec0-4f05-8260-f6494a69393e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:56.039831 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d61fd1c7-6ec0-4f05-8260-f6494a69393e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:56.040597 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d61fd1c7-6ec0-4f05-8260-f6494a69393e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:56.041345 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d61fd1c7-6ec0-4f05-8260-f6494a69393e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:56.042012 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d61fd1c7-6ec0-4f05-8260-f6494a69393e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:56.192345 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-d61fd1c7-6ec0-4f05-8260-f6494a69393e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:56.204384 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-d61fd1c7-6ec0-4f05-8260-f6494a69393e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:56.210255 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-d61fd1c7-6ec0-4f05-8260-f6494a69393e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:56.211692 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-d61fd1c7-6ec0-4f05-8260-f6494a69393e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1730 microversion: 2.20 time: 0.186485 Aug 10 11:38:56.212428 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 338/673] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:38:56 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:38:57.240350 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-e61e5573-eef9-4c44-9fd1-5a152127dd43 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:38:57.241791 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-e61e5573-eef9-4c44-9fd1-5a152127dd43 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:57.250419 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e61e5573-eef9-4c44-9fd1-5a152127dd43 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:57.252318 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e61e5573-eef9-4c44-9fd1-5a152127dd43 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:57.253744 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e61e5573-eef9-4c44-9fd1-5a152127dd43 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:57.255361 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e61e5573-eef9-4c44-9fd1-5a152127dd43 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:57.256524 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e61e5573-eef9-4c44-9fd1-5a152127dd43 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:57.257746 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e61e5573-eef9-4c44-9fd1-5a152127dd43 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:57.437383 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-e61e5573-eef9-4c44-9fd1-5a152127dd43 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:57.446134 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-e61e5573-eef9-4c44-9fd1-5a152127dd43 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:57.448204 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-e61e5573-eef9-4c44-9fd1-5a152127dd43 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:57.449637 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-e61e5573-eef9-4c44-9fd1-5a152127dd43 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1730 microversion: 2.20 time: 0.213575 Aug 10 11:38:57.464370 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 336/674] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:38:57 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1730 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:38:58.474571 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-dff81b4a-ce1f-4abd-9185-cc7e9d8c62a8 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:38:58.475220 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-dff81b4a-ce1f-4abd-9185-cc7e9d8c62a8 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:58.482963 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-dff81b4a-ce1f-4abd-9185-cc7e9d8c62a8 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:58.483826 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-dff81b4a-ce1f-4abd-9185-cc7e9d8c62a8 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:58.484602 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-dff81b4a-ce1f-4abd-9185-cc7e9d8c62a8 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:58.485607 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-dff81b4a-ce1f-4abd-9185-cc7e9d8c62a8 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:58.486207 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-dff81b4a-ce1f-4abd-9185-cc7e9d8c62a8 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:58.486734 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-dff81b4a-ce1f-4abd-9185-cc7e9d8c62a8 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:58.644220 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-dff81b4a-ce1f-4abd-9185-cc7e9d8c62a8 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:58.652079 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-dff81b4a-ce1f-4abd-9185-cc7e9d8c62a8 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:58.653587 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-dff81b4a-ce1f-4abd-9185-cc7e9d8c62a8 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:58.654744 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-dff81b4a-ce1f-4abd-9185-cc7e9d8c62a8 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1730 microversion: 2.20 time: 0.184207 Aug 10 11:38:58.655329 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 339/675] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:38:58 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:38:59.178975 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-b5b76794-5b21-46de-9a4f-6c6b4e9ae91b tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:38:59.188256 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-b5b76794-5b21-46de-9a4f-6c6b4e9ae91b tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: ed538b97-8602-402c-8ef9-e25e6d71356a] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:59.201182 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b5b76794-5b21-46de-9a4f-6c6b4e9ae91b tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:59.209051 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b5b76794-5b21-46de-9a4f-6c6b4e9ae91b tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:59.209717 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b5b76794-5b21-46de-9a4f-6c6b4e9ae91b tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:59.210615 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b5b76794-5b21-46de-9a4f-6c6b4e9ae91b tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:59.211233 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b5b76794-5b21-46de-9a4f-6c6b4e9ae91b tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:59.211826 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b5b76794-5b21-46de-9a4f-6c6b4e9ae91b tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:59.249600 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-b5b76794-5b21-46de-9a4f-6c6b4e9ae91b tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: ed538b97-8602-402c-8ef9-e25e6d71356a] Going to try to terminate instance {{(pid=124682) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:38:59.553117 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-b5b76794-5b21-46de-9a4f-6c6b4e9ae91b tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "DELETE /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a" status: 204 len: 0 microversion: 2.1 time: 0.388212 Aug 10 11:38:59.553980 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 337/676] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 10 11:38:59 2022] DELETE /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:38:59.562230 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-efedbf8e-01cb-4363-bdfc-efd52bb5171e tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:38:59.562899 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-efedbf8e-01cb-4363-bdfc-efd52bb5171e tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: ed538b97-8602-402c-8ef9-e25e6d71356a] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:59.571147 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-efedbf8e-01cb-4363-bdfc-efd52bb5171e tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:59.571147 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-efedbf8e-01cb-4363-bdfc-efd52bb5171e tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:59.571147 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-efedbf8e-01cb-4363-bdfc-efd52bb5171e tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:59.571406 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-efedbf8e-01cb-4363-bdfc-efd52bb5171e tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:59.571753 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-efedbf8e-01cb-4363-bdfc-efd52bb5171e tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:59.572214 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-efedbf8e-01cb-4363-bdfc-efd52bb5171e tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:59.678653 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-b60efd85-0dc4-41f6-b6c1-6e1563a18539 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:38:59.679362 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-b60efd85-0dc4-41f6-b6c1-6e1563a18539 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:38:59.689832 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b60efd85-0dc4-41f6-b6c1-6e1563a18539 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:59.690593 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b60efd85-0dc4-41f6-b6c1-6e1563a18539 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:59.691268 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b60efd85-0dc4-41f6-b6c1-6e1563a18539 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:59.693076 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b60efd85-0dc4-41f6-b6c1-6e1563a18539 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:38:59.694406 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b60efd85-0dc4-41f6-b6c1-6e1563a18539 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:38:59.695645 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b60efd85-0dc4-41f6-b6c1-6e1563a18539 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:38:59.746268 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-efedbf8e-01cb-4363-bdfc-efd52bb5171e tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:59.755714 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-efedbf8e-01cb-4363-bdfc-efd52bb5171e tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a" status: 200 len: 1578 microversion: 2.1 time: 0.197159 Aug 10 11:38:59.757930 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 340/677] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:38:59 2022] GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a => generated 1578 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:38:59.873792 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b60efd85-0dc4-41f6-b6c1-6e1563a18539 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:59.882804 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b60efd85-0dc4-41f6-b6c1-6e1563a18539 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:59.885406 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b60efd85-0dc4-41f6-b6c1-6e1563a18539 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:38:59.887255 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-b60efd85-0dc4-41f6-b6c1-6e1563a18539 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1730 microversion: 2.20 time: 0.212865 Aug 10 11:38:59.888031 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 338/678] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:38:59 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1730 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:39:00.778700 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-fb8b0148-6e2d-4618-a7d1-064b23bc5fbe tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:00.779234 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-fb8b0148-6e2d-4618-a7d1-064b23bc5fbe tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: ed538b97-8602-402c-8ef9-e25e6d71356a] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:00.786068 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fb8b0148-6e2d-4618-a7d1-064b23bc5fbe tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:00.786844 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fb8b0148-6e2d-4618-a7d1-064b23bc5fbe tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:00.787474 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fb8b0148-6e2d-4618-a7d1-064b23bc5fbe tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:00.788451 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fb8b0148-6e2d-4618-a7d1-064b23bc5fbe tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:00.789102 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fb8b0148-6e2d-4618-a7d1-064b23bc5fbe tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:00.789714 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fb8b0148-6e2d-4618-a7d1-064b23bc5fbe tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:00.914409 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-5f80fe80-da98-4608-a380-19924f63bb9e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:00.915128 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-5f80fe80-da98-4608-a380-19924f63bb9e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:00.921704 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5f80fe80-da98-4608-a380-19924f63bb9e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:00.928954 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5f80fe80-da98-4608-a380-19924f63bb9e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:00.929690 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5f80fe80-da98-4608-a380-19924f63bb9e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:00.930654 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5f80fe80-da98-4608-a380-19924f63bb9e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:00.931323 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5f80fe80-da98-4608-a380-19924f63bb9e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:00.932011 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5f80fe80-da98-4608-a380-19924f63bb9e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:00.995147 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-fb8b0148-6e2d-4618-a7d1-064b23bc5fbe tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:01.007175 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-fb8b0148-6e2d-4618-a7d1-064b23bc5fbe tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a" status: 200 len: 1578 microversion: 2.1 time: 0.231248 Aug 10 11:39:01.007770 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 341/679] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:39:00 2022] GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a => generated 1578 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:39:01.134763 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-5f80fe80-da98-4608-a380-19924f63bb9e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:01.144941 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-5f80fe80-da98-4608-a380-19924f63bb9e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:01.147286 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-5f80fe80-da98-4608-a380-19924f63bb9e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:01.148497 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-5f80fe80-da98-4608-a380-19924f63bb9e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1730 microversion: 2.20 time: 0.238644 Aug 10 11:39:01.165443 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 339/680] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:39:00 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1730 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:39:02.039695 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-81fc1176-c32c-4b4c-ae6b-0e9c496c8dd7 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:02.170264 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-81fc1176-c32c-4b4c-ae6b-0e9c496c8dd7 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: ed538b97-8602-402c-8ef9-e25e6d71356a] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:02.170264 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-81fc1176-c32c-4b4c-ae6b-0e9c496c8dd7 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:02.170264 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-81fc1176-c32c-4b4c-ae6b-0e9c496c8dd7 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:02.170264 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-81fc1176-c32c-4b4c-ae6b-0e9c496c8dd7 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:02.173653 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-81fc1176-c32c-4b4c-ae6b-0e9c496c8dd7 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:02.173653 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-81fc1176-c32c-4b4c-ae6b-0e9c496c8dd7 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:02.173653 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-81fc1176-c32c-4b4c-ae6b-0e9c496c8dd7 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:02.175699 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-e297bef8-d3df-47fe-8350-5907d4a60c41 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:02.176354 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-e297bef8-d3df-47fe-8350-5907d4a60c41 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:02.200456 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e297bef8-d3df-47fe-8350-5907d4a60c41 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:02.201464 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e297bef8-d3df-47fe-8350-5907d4a60c41 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:02.202383 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e297bef8-d3df-47fe-8350-5907d4a60c41 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:02.203317 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e297bef8-d3df-47fe-8350-5907d4a60c41 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:02.204505 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e297bef8-d3df-47fe-8350-5907d4a60c41 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:02.205372 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e297bef8-d3df-47fe-8350-5907d4a60c41 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:02.249626 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-81fc1176-c32c-4b4c-ae6b-0e9c496c8dd7 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:02.249626 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-81fc1176-c32c-4b4c-ae6b-0e9c496c8dd7 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a" status: 200 len: 1578 microversion: 2.1 time: 0.198634 Aug 10 11:39:02.249626 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 342/681] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:39:02 2022] GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a => generated 1578 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:39:02.368835 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-e297bef8-d3df-47fe-8350-5907d4a60c41 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:02.377652 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-e297bef8-d3df-47fe-8350-5907d4a60c41 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:02.379143 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-e297bef8-d3df-47fe-8350-5907d4a60c41 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:02.380328 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-e297bef8-d3df-47fe-8350-5907d4a60c41 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1730 microversion: 2.20 time: 0.211116 Aug 10 11:39:02.381372 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 340/682] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:39:02 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1730 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:39:03.271611 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-e6bb7e45-727e-40e5-bf38-abe418174b9a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:03.272352 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-e6bb7e45-727e-40e5-bf38-abe418174b9a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: ed538b97-8602-402c-8ef9-e25e6d71356a] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:03.280760 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e6bb7e45-727e-40e5-bf38-abe418174b9a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:03.283346 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e6bb7e45-727e-40e5-bf38-abe418174b9a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:03.288590 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e6bb7e45-727e-40e5-bf38-abe418174b9a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:03.289685 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e6bb7e45-727e-40e5-bf38-abe418174b9a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:03.290339 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e6bb7e45-727e-40e5-bf38-abe418174b9a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:03.290779 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e6bb7e45-727e-40e5-bf38-abe418174b9a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:03.411881 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-0e926e76-b542-468a-88c6-7d2984497853 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:03.424025 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-0e926e76-b542-468a-88c6-7d2984497853 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:03.424725 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0e926e76-b542-468a-88c6-7d2984497853 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:03.425240 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0e926e76-b542-468a-88c6-7d2984497853 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:03.425688 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0e926e76-b542-468a-88c6-7d2984497853 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:03.426416 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0e926e76-b542-468a-88c6-7d2984497853 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:03.426880 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0e926e76-b542-468a-88c6-7d2984497853 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:03.427307 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0e926e76-b542-468a-88c6-7d2984497853 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:03.479261 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-e6bb7e45-727e-40e5-bf38-abe418174b9a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:03.491233 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-e6bb7e45-727e-40e5-bf38-abe418174b9a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a" status: 200 len: 1578 microversion: 2.1 time: 0.223486 Aug 10 11:39:03.508376 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 343/683] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:39:03 2022] GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a => generated 1578 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:39:03.638361 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-0e926e76-b542-468a-88c6-7d2984497853 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:03.649394 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-0e926e76-b542-468a-88c6-7d2984497853 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:03.650885 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-0e926e76-b542-468a-88c6-7d2984497853 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:03.652237 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-0e926e76-b542-468a-88c6-7d2984497853 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1730 microversion: 2.20 time: 0.244450 Aug 10 11:39:03.652792 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 341/684] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:39:03 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1730 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:39:04.517889 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-31756128-422a-41ff-a5e3-80bddeb87501 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:04.518513 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-31756128-422a-41ff-a5e3-80bddeb87501 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: ed538b97-8602-402c-8ef9-e25e6d71356a] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:04.525058 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-31756128-422a-41ff-a5e3-80bddeb87501 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:04.528525 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-31756128-422a-41ff-a5e3-80bddeb87501 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:04.528525 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-31756128-422a-41ff-a5e3-80bddeb87501 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:04.528525 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-31756128-422a-41ff-a5e3-80bddeb87501 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:04.528525 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-31756128-422a-41ff-a5e3-80bddeb87501 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:04.528920 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-31756128-422a-41ff-a5e3-80bddeb87501 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:04.667310 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-31756128-422a-41ff-a5e3-80bddeb87501 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:04.672460 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-31756128-422a-41ff-a5e3-80bddeb87501 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a" status: 200 len: 1578 microversion: 2.1 time: 0.159334 Aug 10 11:39:04.673035 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 344/685] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:39:04 2022] GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:39:04.679300 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-b790b93f-e5ef-4c13-86d1-09695e978659 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:04.680104 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-b790b93f-e5ef-4c13-86d1-09695e978659 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:04.686493 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b790b93f-e5ef-4c13-86d1-09695e978659 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:04.686962 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b790b93f-e5ef-4c13-86d1-09695e978659 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:04.687424 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b790b93f-e5ef-4c13-86d1-09695e978659 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:04.688153 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b790b93f-e5ef-4c13-86d1-09695e978659 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:04.688602 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b790b93f-e5ef-4c13-86d1-09695e978659 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:04.693051 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b790b93f-e5ef-4c13-86d1-09695e978659 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:04.819637 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b790b93f-e5ef-4c13-86d1-09695e978659 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:04.827611 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b790b93f-e5ef-4c13-86d1-09695e978659 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:04.829528 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b790b93f-e5ef-4c13-86d1-09695e978659 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:04.830740 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-b790b93f-e5ef-4c13-86d1-09695e978659 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1730 microversion: 2.20 time: 0.158760 Aug 10 11:39:04.831291 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 342/686] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:39:04 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:39:05.693752 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-e221b9cc-1041-48a8-94e6-5852e669bda9 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:05.694888 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-e221b9cc-1041-48a8-94e6-5852e669bda9 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: ed538b97-8602-402c-8ef9-e25e6d71356a] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:05.701258 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e221b9cc-1041-48a8-94e6-5852e669bda9 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:05.701749 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e221b9cc-1041-48a8-94e6-5852e669bda9 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:05.702182 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e221b9cc-1041-48a8-94e6-5852e669bda9 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:05.702874 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e221b9cc-1041-48a8-94e6-5852e669bda9 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:05.703939 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e221b9cc-1041-48a8-94e6-5852e669bda9 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:05.704584 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e221b9cc-1041-48a8-94e6-5852e669bda9 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:05.841940 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-e221b9cc-1041-48a8-94e6-5852e669bda9 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:05.849781 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-e221b9cc-1041-48a8-94e6-5852e669bda9 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a" status: 200 len: 1578 microversion: 2.1 time: 0.160066 Aug 10 11:39:05.850356 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 345/687] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:39:05 2022] GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:39:05.852561 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-6b0cde9c-615b-423b-bfeb-99c429786ae7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:05.853170 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-6b0cde9c-615b-423b-bfeb-99c429786ae7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:05.859459 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6b0cde9c-615b-423b-bfeb-99c429786ae7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:05.859989 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6b0cde9c-615b-423b-bfeb-99c429786ae7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:05.860440 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6b0cde9c-615b-423b-bfeb-99c429786ae7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:05.861123 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6b0cde9c-615b-423b-bfeb-99c429786ae7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:05.861574 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6b0cde9c-615b-423b-bfeb-99c429786ae7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:05.861998 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6b0cde9c-615b-423b-bfeb-99c429786ae7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:05.988319 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-6b0cde9c-615b-423b-bfeb-99c429786ae7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:05.996138 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-6b0cde9c-615b-423b-bfeb-99c429786ae7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:05.997622 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-6b0cde9c-615b-423b-bfeb-99c429786ae7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:05.998749 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-6b0cde9c-615b-423b-bfeb-99c429786ae7 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1730 microversion: 2.20 time: 0.150087 Aug 10 11:39:05.999303 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 343/688] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:39:05 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:39:06.870924 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-1c085c33-0a59-44eb-9c9f-258c711c1736 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:06.871619 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-1c085c33-0a59-44eb-9c9f-258c711c1736 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: ed538b97-8602-402c-8ef9-e25e6d71356a] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:06.879789 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1c085c33-0a59-44eb-9c9f-258c711c1736 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:06.880316 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1c085c33-0a59-44eb-9c9f-258c711c1736 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:06.881615 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1c085c33-0a59-44eb-9c9f-258c711c1736 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:06.881615 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1c085c33-0a59-44eb-9c9f-258c711c1736 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:06.881913 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1c085c33-0a59-44eb-9c9f-258c711c1736 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:06.882367 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1c085c33-0a59-44eb-9c9f-258c711c1736 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:07.016783 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-1c085c33-0a59-44eb-9c9f-258c711c1736 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:07.022015 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-0b5a9a8e-c4f8-44c2-83bd-8d32c0bd4ada tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:07.022626 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-0b5a9a8e-c4f8-44c2-83bd-8d32c0bd4ada tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:07.024313 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-1c085c33-0a59-44eb-9c9f-258c711c1736 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a" status: 200 len: 1578 microversion: 2.1 time: 0.157531 Aug 10 11:39:07.024900 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 346/689] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:39:06 2022] GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:39:07.029169 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0b5a9a8e-c4f8-44c2-83bd-8d32c0bd4ada tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:07.029654 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0b5a9a8e-c4f8-44c2-83bd-8d32c0bd4ada tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:07.030092 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0b5a9a8e-c4f8-44c2-83bd-8d32c0bd4ada tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:07.030791 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0b5a9a8e-c4f8-44c2-83bd-8d32c0bd4ada tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:07.031239 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0b5a9a8e-c4f8-44c2-83bd-8d32c0bd4ada tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:07.031665 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0b5a9a8e-c4f8-44c2-83bd-8d32c0bd4ada tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:07.162824 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-0b5a9a8e-c4f8-44c2-83bd-8d32c0bd4ada tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:07.170773 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-0b5a9a8e-c4f8-44c2-83bd-8d32c0bd4ada tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:07.172266 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-0b5a9a8e-c4f8-44c2-83bd-8d32c0bd4ada tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:07.173918 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-0b5a9a8e-c4f8-44c2-83bd-8d32c0bd4ada tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1730 microversion: 2.20 time: 0.155772 Aug 10 11:39:07.174484 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 344/690] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:39:07 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:39:07.897356 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-8637dc27-6a09-473e-897a-f96a39cadf76 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:07.901331 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-8637dc27-6a09-473e-897a-f96a39cadf76 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: ae770112-a153-4fc8-97ea-637cd10d7024] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:07.908703 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8637dc27-6a09-473e-897a-f96a39cadf76 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:07.909383 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8637dc27-6a09-473e-897a-f96a39cadf76 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:07.909834 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8637dc27-6a09-473e-897a-f96a39cadf76 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:07.910516 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8637dc27-6a09-473e-897a-f96a39cadf76 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:07.910971 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8637dc27-6a09-473e-897a-f96a39cadf76 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:07.911565 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8637dc27-6a09-473e-897a-f96a39cadf76 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:07.945865 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-8637dc27-6a09-473e-897a-f96a39cadf76 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.052441 Aug 10 11:39:07.946699 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 347/691] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 10 11:39:07 2022] GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024/os-volume_attachments => generated 371 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:39:08.045466 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-f032ebc9-78bb-4899-9ab1-3966854cc76f tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:08.046085 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-f032ebc9-78bb-4899-9ab1-3966854cc76f tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: ed538b97-8602-402c-8ef9-e25e6d71356a] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:08.054238 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f032ebc9-78bb-4899-9ab1-3966854cc76f tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:08.054238 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f032ebc9-78bb-4899-9ab1-3966854cc76f tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:08.054238 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f032ebc9-78bb-4899-9ab1-3966854cc76f tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:08.054627 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f032ebc9-78bb-4899-9ab1-3966854cc76f tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:08.055078 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f032ebc9-78bb-4899-9ab1-3966854cc76f tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:08.055556 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f032ebc9-78bb-4899-9ab1-3966854cc76f tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:08.089304 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-1ea1ce7c-d66c-40a1-8796-8929df886dc4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:08.089795 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-1ea1ce7c-d66c-40a1-8796-8929df886dc4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: ae770112-a153-4fc8-97ea-637cd10d7024] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:08.097082 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1ea1ce7c-d66c-40a1-8796-8929df886dc4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:08.102643 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1ea1ce7c-d66c-40a1-8796-8929df886dc4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:08.102643 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1ea1ce7c-d66c-40a1-8796-8929df886dc4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:08.102643 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1ea1ce7c-d66c-40a1-8796-8929df886dc4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:08.102643 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1ea1ce7c-d66c-40a1-8796-8929df886dc4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:08.103002 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1ea1ce7c-d66c-40a1-8796-8929df886dc4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:08.132572 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-1ea1ce7c-d66c-40a1-8796-8929df886dc4 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024/os-volume_attachments/8d5967f5-1d06-4890-b4b0-87a60f4fe8ef" status: 200 len: 194 microversion: 2.1 time: 0.047282 Aug 10 11:39:08.133180 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 348/692] 10.222.0.62 () {58 vars in 1413 bytes} [Wed Aug 10 11:39:08 2022] GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024/os-volume_attachments/8d5967f5-1d06-4890-b4b0-87a60f4fe8ef => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:39:08.144194 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-da68345e-c255-47fd-a55a-a8cd8e192948 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:08.144694 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-da68345e-c255-47fd-a55a-a8cd8e192948 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: ae770112-a153-4fc8-97ea-637cd10d7024] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:08.150593 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-da68345e-c255-47fd-a55a-a8cd8e192948 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:08.151081 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-da68345e-c255-47fd-a55a-a8cd8e192948 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:08.151520 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-da68345e-c255-47fd-a55a-a8cd8e192948 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:08.152240 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-da68345e-c255-47fd-a55a-a8cd8e192948 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:08.152730 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-da68345e-c255-47fd-a55a-a8cd8e192948 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:08.153157 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-da68345e-c255-47fd-a55a-a8cd8e192948 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:08.262330 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.objects.instance [None req-da68345e-c255-47fd-a55a-a8cd8e192948 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lazy-loading 'services' on Instance uuid ae770112-a153-4fc8-97ea-637cd10d7024 {{(pid=124683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:39:08.334539 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-f032ebc9-78bb-4899-9ab1-3966854cc76f tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:08.342240 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-f032ebc9-78bb-4899-9ab1-3966854cc76f tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a" status: 200 len: 1578 microversion: 2.1 time: 0.300846 Aug 10 11:39:08.342857 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 345/693] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:39:08 2022] GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a => generated 1578 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:39:08.347733 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-dd63a293-314c-43a7-afa4-7418436cdec4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:08.348358 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-dd63a293-314c-43a7-afa4-7418436cdec4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:08.355692 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-dd63a293-314c-43a7-afa4-7418436cdec4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:08.356475 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-dd63a293-314c-43a7-afa4-7418436cdec4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:08.356915 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-dd63a293-314c-43a7-afa4-7418436cdec4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:08.357618 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-dd63a293-314c-43a7-afa4-7418436cdec4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:08.358072 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-dd63a293-314c-43a7-afa4-7418436cdec4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:08.358495 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-dd63a293-314c-43a7-afa4-7418436cdec4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:08.396879 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:INSERT=2,nova_cell1:SELECT=94 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:39:08.484697 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-da68345e-c255-47fd-a55a-a8cd8e192948 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "DELETE /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024/os-volume_attachments/8d5967f5-1d06-4890-b4b0-87a60f4fe8ef" status: 202 len: 0 microversion: 2.1 time: 0.344665 Aug 10 11:39:08.486193 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 349/694] 10.222.0.62 () {58 vars in 1416 bytes} [Wed Aug 10 11:39:08 2022] DELETE /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024/os-volume_attachments/8d5967f5-1d06-4890-b4b0-87a60f4fe8ef => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 11:39:08.611376 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-dd63a293-314c-43a7-afa4-7418436cdec4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:08.638234 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-dd63a293-314c-43a7-afa4-7418436cdec4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:08.645470 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-dd63a293-314c-43a7-afa4-7418436cdec4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:08.648859 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-dd63a293-314c-43a7-afa4-7418436cdec4 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1730 microversion: 2.20 time: 0.304735 Aug 10 11:39:08.649462 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 346/695] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:39:08 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1730 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:39:08.897496 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-635b72ab-1814-481f-ad64-1a4cc6ac1b4a req-fba4bb52-1a8b-4c47-b087-e7cef6632635 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed538b97-8602-402c-8ef9-e25e6d71356a", "name": "network-vif-deleted", "tag": "28ec2bce-b922-4871-b61a-a1d936982071"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:39:08.909243 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-635b72ab-1814-481f-ad64-1a4cc6ac1b4a req-fba4bb52-1a8b-4c47-b087-e7cef6632635 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:08.909243 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-635b72ab-1814-481f-ad64-1a4cc6ac1b4a req-fba4bb52-1a8b-4c47-b087-e7cef6632635 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:08.909534 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-635b72ab-1814-481f-ad64-1a4cc6ac1b4a req-fba4bb52-1a8b-4c47-b087-e7cef6632635 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:08.922417 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-635b72ab-1814-481f-ad64-1a4cc6ac1b4a req-fba4bb52-1a8b-4c47-b087-e7cef6632635 service nova] Creating event network-vif-deleted:28ec2bce-b922-4871-b61a-a1d936982071 for instance ed538b97-8602-402c-8ef9-e25e6d71356a on hv-cinder-85272 Aug 10 11:39:08.928170 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-635b72ab-1814-481f-ad64-1a4cc6ac1b4a req-fba4bb52-1a8b-4c47-b087-e7cef6632635 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.307879 Aug 10 11:39:08.929151 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 350/696] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:39:09.362943 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-6d9295b2-a084-4d91-947f-cb4f9b12af05 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:09.364174 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-6d9295b2-a084-4d91-947f-cb4f9b12af05 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: ed538b97-8602-402c-8ef9-e25e6d71356a] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:09.371008 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6d9295b2-a084-4d91-947f-cb4f9b12af05 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:09.371507 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6d9295b2-a084-4d91-947f-cb4f9b12af05 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:09.372021 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6d9295b2-a084-4d91-947f-cb4f9b12af05 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:09.380050 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6d9295b2-a084-4d91-947f-cb4f9b12af05 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:09.380050 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6d9295b2-a084-4d91-947f-cb4f9b12af05 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:09.380050 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6d9295b2-a084-4d91-947f-cb4f9b12af05 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:09.455944 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-6d9295b2-a084-4d91-947f-cb4f9b12af05 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:09.460398 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-6d9295b2-a084-4d91-947f-cb4f9b12af05 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a" status: 200 len: 1225 microversion: 2.1 time: 0.101495 Aug 10 11:39:09.464101 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 347/697] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:39:09 2022] GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:39:09.677616 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-95ba72e5-7631-4dac-8abd-fb164061d84e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:09.678662 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-95ba72e5-7631-4dac-8abd-fb164061d84e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:09.685376 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-95ba72e5-7631-4dac-8abd-fb164061d84e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:09.685961 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-95ba72e5-7631-4dac-8abd-fb164061d84e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:09.686625 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-95ba72e5-7631-4dac-8abd-fb164061d84e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:09.687451 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-95ba72e5-7631-4dac-8abd-fb164061d84e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:09.687987 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-95ba72e5-7631-4dac-8abd-fb164061d84e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:09.688664 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-95ba72e5-7631-4dac-8abd-fb164061d84e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:09.828163 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-95ba72e5-7631-4dac-8abd-fb164061d84e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:09.837907 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-95ba72e5-7631-4dac-8abd-fb164061d84e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:09.839358 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-95ba72e5-7631-4dac-8abd-fb164061d84e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:09.840581 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-95ba72e5-7631-4dac-8abd-fb164061d84e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1730 microversion: 2.20 time: 0.170925 Aug 10 11:39:09.841141 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 351/698] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:39:09 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:39:10.481830 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-cdd0af2c-0e19-4512-979c-8454adb3587d tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:10.483194 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-cdd0af2c-0e19-4512-979c-8454adb3587d tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: ed538b97-8602-402c-8ef9-e25e6d71356a] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:10.490443 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cdd0af2c-0e19-4512-979c-8454adb3587d tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:10.490934 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cdd0af2c-0e19-4512-979c-8454adb3587d tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:10.491373 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cdd0af2c-0e19-4512-979c-8454adb3587d tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:10.492103 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cdd0af2c-0e19-4512-979c-8454adb3587d tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:10.492563 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cdd0af2c-0e19-4512-979c-8454adb3587d tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:10.493252 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cdd0af2c-0e19-4512-979c-8454adb3587d tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:10.507127 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.wsgi [None req-cdd0af2c-0e19-4512-979c-8454adb3587d tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] HTTP exception thrown: Instance ed538b97-8602-402c-8ef9-e25e6d71356a could not be found. Aug 10 11:39:10.508978 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-cdd0af2c-0e19-4512-979c-8454adb3587d tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Request method failure captured: Aug 10 11:39:10.508978 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: request: GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a HTTP/1.1 Aug 10 11:39:10.508978 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Accept: application/json Aug 10 11:39:10.508978 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Aug 10 11:39:10.508978 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Connection: close Aug 10 11:39:10.508978 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Content-Length: 0 Aug 10 11:39:10.508978 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Content-Type: application/json Aug 10 11:39:10.508978 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Host: 10.222.0.62 Aug 10 11:39:10.508978 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Aug 10 11:39:10.508978 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.11 Aug 10 11:39:10.508978 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABi85gTsVtOigC__4GPwavS26SrwsqOH5ANgJJiPHSnmoCdCFlO7Vv0aBh05d4R9g2_M6UNx2hiNfTLZMacfAkeEGchE5_8fTQkP7MDbQDxP9RuWPJOYKVIFLm5not1Hcvns6F-kn4NACae59sRkBuf232itUJbqeNgXSPZetV0wqsoemo Aug 10 11:39:10.508978 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Aug 10 11:39:10.508978 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Aug 10 11:39:10.508978 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Aug 10 11:39:10.508978 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Aug 10 11:39:10.508978 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Aug 10 11:39:10.508978 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Aug 10 11:39:10.508978 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Id: 1c9f7b60a16e438a89c4f7248707ae2d Aug 10 11:39:10.508978 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-TestVolumeBootPattern-195522797 Aug 10 11:39:10.508978 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Role: member,reader Aug 10 11:39:10.508978 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Aug 10 11:39:10.510460 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1c9f7b60a16e438a89c4f7248707ae2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1c9f7b60a16e438a89c4f7248707ae2d", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1c9f7b60a16e438a89c4f7248707ae2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1c9f7b60a16e438a89c4f7248707ae2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:39:10.510460 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-TestVolumeBootPattern-195522797 Aug 10 11:39:10.510460 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant-Id: 1c9f7b60a16e438a89c4f7248707ae2d Aug 10 11:39:10.510460 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-TestVolumeBootPattern-195522797 Aug 10 11:39:10.510460 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User: tempest-TestVolumeBootPattern-195522797-project Aug 10 11:39:10.510460 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Aug 10 11:39:10.510460 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Aug 10 11:39:10.510460 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Id: 83d48f0f35644f23a0fc2216e5ec5a2c Aug 10 11:39:10.510460 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-TestVolumeBootPattern-195522797-project Aug 10 11:39:10.510460 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: method: > Aug 10 11:39:10.510460 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: exception: Instance ed538b97-8602-402c-8ef9-e25e6d71356a could not be found. Aug 10 11:39:10.510460 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: action_args: {'id': 'ed538b97-8602-402c-8ef9-e25e6d71356a'} Aug 10 11:39:10.511324 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:39:10.511324 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:39:10.511324 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:39:10.511324 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:39:10.511324 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:39:10.511324 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:39:10.511324 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:39:10.511324 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:39:10.511324 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:39:10.511324 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:39:10.511324 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed538b97-8602-402c-8ef9-e25e6d71356a could not be found. Aug 10 11:39:10.511324 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:39:10.511324 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:39:10.511324 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:39:10.511324 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:39:10.511324 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:39:10.511324 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:39:10.511324 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:39:10.511324 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:39:10.511324 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:39:10.512679 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:39:10.512679 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:39:10.512679 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:39:10.512679 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:39:10.512679 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:39:10.512679 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:39:10.512679 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:39:10.512679 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed538b97-8602-402c-8ef9-e25e6d71356a could not be found. Aug 10 11:39:10.512679 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:39:10.512679 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:39:10.512679 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:39:10.512679 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:39:10.512679 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:39:10.512679 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:39:10.512679 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:39:10.512679 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:39:10.512679 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed538b97-8602-402c-8ef9-e25e6d71356a could not be found. Aug 10 11:39:10.512679 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:39:10.513912 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-cdd0af2c-0e19-4512-979c-8454adb3587d tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Returning 404 to user: Instance ed538b97-8602-402c-8ef9-e25e6d71356a could not be found. {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:39:10.513912 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-cdd0af2c-0e19-4512-979c-8454adb3587d tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a" status: 404 len: 111 microversion: 2.1 time: 0.032566 Aug 10 11:39:10.513912 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 348/699] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:39:10 2022] GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:39:10.624982 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-23688fc4-cab1-4e13-a943-0ae9e745039a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1531470021", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1346196899", "security_groups": [{"name": "tempest-secgroup-smoke-1297018732"}], "block_device_mapping_v2": [{"uuid": "e6f1e6d3-3448-489e-801c-3f45a1e02a0a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0d452e82-3b0d-4e6a-b6c3-744763a38d5a"}]}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:39:10.690709 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-705f208d-187a-4e66-b688-8ba4caa012fc tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:10.691316 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-705f208d-187a-4e66-b688-8ba4caa012fc tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: ae770112-a153-4fc8-97ea-637cd10d7024] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:10.697446 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-705f208d-187a-4e66-b688-8ba4caa012fc tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:10.697932 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-705f208d-187a-4e66-b688-8ba4caa012fc tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:10.698370 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-705f208d-187a-4e66-b688-8ba4caa012fc tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:10.699064 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-705f208d-187a-4e66-b688-8ba4caa012fc tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:10.699528 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-705f208d-187a-4e66-b688-8ba4caa012fc tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:10.699957 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-705f208d-187a-4e66-b688-8ba4caa012fc tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:10.729573 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-705f208d-187a-4e66-b688-8ba4caa012fc tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024/os-volume_attachments/c42527d2-82a2-4544-a269-3d45b2dac9b4" status: 200 len: 194 microversion: 2.1 time: 0.043167 Aug 10 11:39:10.730778 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 349/700] 10.222.0.62 () {58 vars in 1413 bytes} [Wed Aug 10 11:39:10 2022] GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024/os-volume_attachments/c42527d2-82a2-4544-a269-3d45b2dac9b4 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:39:10.742336 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-2d845059-133f-41a5-a380-271c995ad049 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:10.742851 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-2d845059-133f-41a5-a380-271c995ad049 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: ae770112-a153-4fc8-97ea-637cd10d7024] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:10.749281 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2d845059-133f-41a5-a380-271c995ad049 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:10.749681 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.network.neutron [None req-23688fc4-cab1-4e13-a943-0ae9e745039a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] validate_networks() for [('0d452e82-3b0d-4e6a-b6c3-744763a38d5a', None, None, None, None, None)] {{(pid=124683) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:39:10.749930 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2d845059-133f-41a5-a380-271c995ad049 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:10.750369 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2d845059-133f-41a5-a380-271c995ad049 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:10.751155 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2d845059-133f-41a5-a380-271c995ad049 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:10.751718 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2d845059-133f-41a5-a380-271c995ad049 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:10.752317 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2d845059-133f-41a5-a380-271c995ad049 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:10.847927 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.objects.instance [None req-2d845059-133f-41a5-a380-271c995ad049 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lazy-loading 'services' on Instance uuid ae770112-a153-4fc8-97ea-637cd10d7024 {{(pid=124682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:39:10.847927 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:39:11.043864 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-2d845059-133f-41a5-a380-271c995ad049 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "DELETE /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024/os-volume_attachments/c42527d2-82a2-4544-a269-3d45b2dac9b4" status: 202 len: 0 microversion: 2.1 time: 0.305420 Aug 10 11:39:11.044508 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 350/701] 10.222.0.62 () {58 vars in 1416 bytes} [Wed Aug 10 11:39:10 2022] DELETE /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024/os-volume_attachments/c42527d2-82a2-4544-a269-3d45b2dac9b4 => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 11:39:11.058943 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-ceb6bc9f-af7e-4e79-892e-dcc5a369452a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:11.061827 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-ceb6bc9f-af7e-4e79-892e-dcc5a369452a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:11.069675 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ceb6bc9f-af7e-4e79-892e-dcc5a369452a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:11.070600 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ceb6bc9f-af7e-4e79-892e-dcc5a369452a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:11.071880 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ceb6bc9f-af7e-4e79-892e-dcc5a369452a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:11.072952 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ceb6bc9f-af7e-4e79-892e-dcc5a369452a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:11.074040 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ceb6bc9f-af7e-4e79-892e-dcc5a369452a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:11.074741 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ceb6bc9f-af7e-4e79-892e-dcc5a369452a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:11.226745 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-ceb6bc9f-af7e-4e79-892e-dcc5a369452a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:11.235689 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-ceb6bc9f-af7e-4e79-892e-dcc5a369452a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:11.237477 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-ceb6bc9f-af7e-4e79-892e-dcc5a369452a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:11.238865 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-ceb6bc9f-af7e-4e79-892e-dcc5a369452a tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1730 microversion: 2.20 time: 0.193289 Aug 10 11:39:11.239630 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 351/702] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:39:11 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1730 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:39:11.517241 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-23688fc4-cab1-4e13-a943-0ae9e745039a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Flavor limits 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:39:11.517914 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-23688fc4-cab1-4e13-a943-0ae9e745039a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Image limits 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:39:11.518650 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-23688fc4-cab1-4e13-a943-0ae9e745039a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Flavor pref 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:39:11.519066 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-23688fc4-cab1-4e13-a943-0ae9e745039a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Image pref 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:39:11.519479 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-23688fc4-cab1-4e13-a943-0ae9e745039a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:39:11.528262 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-23688fc4-cab1-4e13-a943-0ae9e745039a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:11.528743 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-23688fc4-cab1-4e13-a943-0ae9e745039a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:11.529173 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-23688fc4-cab1-4e13-a943-0ae9e745039a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:11.529934 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-23688fc4-cab1-4e13-a943-0ae9e745039a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:11.530391 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-23688fc4-cab1-4e13-a943-0ae9e745039a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:11.530830 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-23688fc4-cab1-4e13-a943-0ae9e745039a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:11.547804 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-23688fc4-cab1-4e13-a943-0ae9e745039a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Getting quotas for project 1c9f7b60a16e438a89c4f7248707ae2d. Resources: {'ram', 'instances', 'cores'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:39:11.551765 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-23688fc4-cab1-4e13-a943-0ae9e745039a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Getting quotas for user 83d48f0f35644f23a0fc2216e5ec5a2c and project 1c9f7b60a16e438a89c4f7248707ae2d. Resources: {'ram', 'instances', 'cores'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:39:11.611801 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-23688fc4-cab1-4e13-a943-0ae9e745039a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Going to run 1 instances... {{(pid=124683) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:39:11.613988 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-23688fc4-cab1-4e13-a943-0ae9e745039a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: c07ab9eb-c1e1-4751-be52-6af1da8790e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e6f1e6d3-3448-489e-801c-3f45a1e02a0a',volume_size=None,volume_type=None)] {{(pid=124683) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:39:12.068890 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-23688fc4-cab1-4e13-a943-0ae9e745039a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.447520 Aug 10 11:39:12.082943 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-e0c76e2f-d793-47cd-9330-cf10d05cb2e5 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:12.084557 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-e0c76e2f-d793-47cd-9330-cf10d05cb2e5 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: c07ab9eb-c1e1-4751-be52-6af1da8790e5] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:12.097398 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 352/703] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Aug 10 11:39:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 1469 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 11:39:12.123089 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-4e9b2b57-09ea-44b9-b455-99825c333c68 req-d7f49717-dc8d-4e6f-8f07-e15090f1a946 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "865edaf1-a2d9-492e-af4c-05e5aecd6cf8", "name": "network-vif-plugged", "status": "completed", "tag": "61acbadb-ed19-49d1-a43f-0e58327b568a"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:39:12.135658 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-4e9b2b57-09ea-44b9-b455-99825c333c68 req-d7f49717-dc8d-4e6f-8f07-e15090f1a946 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:12.136174 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-4e9b2b57-09ea-44b9-b455-99825c333c68 req-d7f49717-dc8d-4e6f-8f07-e15090f1a946 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:12.138012 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-4e9b2b57-09ea-44b9-b455-99825c333c68 req-d7f49717-dc8d-4e6f-8f07-e15090f1a946 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:12.152171 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-4e9b2b57-09ea-44b9-b455-99825c333c68 req-d7f49717-dc8d-4e6f-8f07-e15090f1a946 service nova] Creating event network-vif-plugged:61acbadb-ed19-49d1-a43f-0e58327b568a for instance 865edaf1-a2d9-492e-af4c-05e5aecd6cf8 on hv-cinder-85272 Aug 10 11:39:12.157623 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-4e9b2b57-09ea-44b9-b455-99825c333c68 req-d7f49717-dc8d-4e6f-8f07-e15090f1a946 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040118 Aug 10 11:39:12.158821 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 353/704] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:39:12.193204 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-e0c76e2f-d793-47cd-9330-cf10d05cb2e5 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:12.203013 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-e0c76e2f-d793-47cd-9330-cf10d05cb2e5 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/c07ab9eb-c1e1-4751-be52-6af1da8790e5" status: 200 len: 1095 microversion: 2.1 time: 0.125222 Aug 10 11:39:12.204594 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 352/705] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:39:12 2022] GET /compute/v2.1/servers/c07ab9eb-c1e1-4751-be52-6af1da8790e5 => generated 1095 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:39:12.263655 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-df8a09d3-3534-451b-a27c-7f72c246595f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:12.264393 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-df8a09d3-3534-451b-a27c-7f72c246595f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:12.274458 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-df8a09d3-3534-451b-a27c-7f72c246595f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:12.275628 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-df8a09d3-3534-451b-a27c-7f72c246595f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:12.276438 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-df8a09d3-3534-451b-a27c-7f72c246595f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:12.278101 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-df8a09d3-3534-451b-a27c-7f72c246595f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:12.278912 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-df8a09d3-3534-451b-a27c-7f72c246595f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:12.279712 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-df8a09d3-3534-451b-a27c-7f72c246595f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:12.329602 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-fd44245c-f3a9-41c5-9773-cc1f69044bda tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:12.332166 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-fd44245c-f3a9-41c5-9773-cc1f69044bda tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: ae770112-a153-4fc8-97ea-637cd10d7024] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:12.339803 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fd44245c-f3a9-41c5-9773-cc1f69044bda tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:12.340925 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fd44245c-f3a9-41c5-9773-cc1f69044bda tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:12.341573 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fd44245c-f3a9-41c5-9773-cc1f69044bda tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:12.342525 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fd44245c-f3a9-41c5-9773-cc1f69044bda tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:12.343199 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fd44245c-f3a9-41c5-9773-cc1f69044bda tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:12.343890 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fd44245c-f3a9-41c5-9773-cc1f69044bda tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:12.378656 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-fd44245c-f3a9-41c5-9773-cc1f69044bda tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054419 Aug 10 11:39:12.379610 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 353/706] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 10 11:39:12 2022] GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 11:39:12.466924 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-df8a09d3-3534-451b-a27c-7f72c246595f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:12.487291 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-df8a09d3-3534-451b-a27c-7f72c246595f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:12.487291 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-df8a09d3-3534-451b-a27c-7f72c246595f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:12.487291 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-df8a09d3-3534-451b-a27c-7f72c246595f tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1730 microversion: 2.20 time: 0.222926 Aug 10 11:39:12.487816 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 354/707] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:39:12 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1730 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:39:12.543811 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-79d0d1f8-16ba-475b-a720-8ac895475879 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:12.543811 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-79d0d1f8-16ba-475b-a720-8ac895475879 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: ae770112-a153-4fc8-97ea-637cd10d7024] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:12.548555 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-79d0d1f8-16ba-475b-a720-8ac895475879 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:12.549271 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-79d0d1f8-16ba-475b-a720-8ac895475879 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:12.549705 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-79d0d1f8-16ba-475b-a720-8ac895475879 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:12.551710 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-79d0d1f8-16ba-475b-a720-8ac895475879 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:12.552686 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-79d0d1f8-16ba-475b-a720-8ac895475879 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:12.553455 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-79d0d1f8-16ba-475b-a720-8ac895475879 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:12.590220 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-79d0d1f8-16ba-475b-a720-8ac895475879 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057986 Aug 10 11:39:12.592108 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 354/708] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 10 11:39:12 2022] GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 11:39:12.682928 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-94c63c81-6a82-47ef-a536-a6aa925a6c16 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:12.683662 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-94c63c81-6a82-47ef-a536-a6aa925a6c16 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: ae770112-a153-4fc8-97ea-637cd10d7024] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:12.691707 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-94c63c81-6a82-47ef-a536-a6aa925a6c16 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:12.692277 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-94c63c81-6a82-47ef-a536-a6aa925a6c16 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:12.692708 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-94c63c81-6a82-47ef-a536-a6aa925a6c16 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:12.693437 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-94c63c81-6a82-47ef-a536-a6aa925a6c16 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:12.693888 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-94c63c81-6a82-47ef-a536-a6aa925a6c16 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:12.694312 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-94c63c81-6a82-47ef-a536-a6aa925a6c16 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:12.719582 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-94c63c81-6a82-47ef-a536-a6aa925a6c16 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: ae770112-a153-4fc8-97ea-637cd10d7024] Going to try to terminate instance {{(pid=124683) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:39:13.004609 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-94c63c81-6a82-47ef-a536-a6aa925a6c16 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "DELETE /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024" status: 204 len: 0 microversion: 2.1 time: 0.334583 Aug 10 11:39:13.005293 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 355/709] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 10 11:39:12 2022] DELETE /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:39:13.013676 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-4c356cbf-f1d8-444c-b529-dcb75086e4e6 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:13.014311 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-4c356cbf-f1d8-444c-b529-dcb75086e4e6 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: ae770112-a153-4fc8-97ea-637cd10d7024] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:13.021170 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4c356cbf-f1d8-444c-b529-dcb75086e4e6 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:13.021711 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4c356cbf-f1d8-444c-b529-dcb75086e4e6 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:13.022071 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4c356cbf-f1d8-444c-b529-dcb75086e4e6 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:13.026808 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4c356cbf-f1d8-444c-b529-dcb75086e4e6 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:13.027284 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4c356cbf-f1d8-444c-b529-dcb75086e4e6 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:13.027721 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4c356cbf-f1d8-444c-b529-dcb75086e4e6 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:13.165006 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-4c356cbf-f1d8-444c-b529-dcb75086e4e6 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:13.174047 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-4c356cbf-f1d8-444c-b529-dcb75086e4e6 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024" status: 200 len: 1672 microversion: 2.1 time: 0.163869 Aug 10 11:39:13.179558 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 355/710] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:39:13 2022] GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024 => generated 1672 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:39:13.235044 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-1f7aa422-ecc1-4735-9217-667fe1dc7934 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:13.236555 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-1f7aa422-ecc1-4735-9217-667fe1dc7934 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: c07ab9eb-c1e1-4751-be52-6af1da8790e5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:13.241665 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1f7aa422-ecc1-4735-9217-667fe1dc7934 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:13.242156 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1f7aa422-ecc1-4735-9217-667fe1dc7934 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:13.242591 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1f7aa422-ecc1-4735-9217-667fe1dc7934 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:13.243277 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1f7aa422-ecc1-4735-9217-667fe1dc7934 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:13.243862 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1f7aa422-ecc1-4735-9217-667fe1dc7934 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:13.244314 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1f7aa422-ecc1-4735-9217-667fe1dc7934 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:13.307445 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-1f7aa422-ecc1-4735-9217-667fe1dc7934 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:13.315859 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-1f7aa422-ecc1-4735-9217-667fe1dc7934 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/c07ab9eb-c1e1-4751-be52-6af1da8790e5" status: 200 len: 1145 microversion: 2.1 time: 0.084971 Aug 10 11:39:13.316469 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 356/711] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:39:13 2022] GET /compute/v2.1/servers/c07ab9eb-c1e1-4751-be52-6af1da8790e5 => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:39:13.508143 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-c20271cd-d8d5-4083-974f-ec0f09a59d3e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:13.508770 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-c20271cd-d8d5-4083-974f-ec0f09a59d3e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:13.514872 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c20271cd-d8d5-4083-974f-ec0f09a59d3e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:13.515658 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c20271cd-d8d5-4083-974f-ec0f09a59d3e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:13.516217 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c20271cd-d8d5-4083-974f-ec0f09a59d3e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:13.518107 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c20271cd-d8d5-4083-974f-ec0f09a59d3e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:13.518571 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c20271cd-d8d5-4083-974f-ec0f09a59d3e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:13.519001 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c20271cd-d8d5-4083-974f-ec0f09a59d3e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:13.652279 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c20271cd-d8d5-4083-974f-ec0f09a59d3e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:13.661167 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c20271cd-d8d5-4083-974f-ec0f09a59d3e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:13.662662 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c20271cd-d8d5-4083-974f-ec0f09a59d3e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:13.663830 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-c20271cd-d8d5-4083-974f-ec0f09a59d3e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1730 microversion: 2.20 time: 0.159609 Aug 10 11:39:13.667942 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 356/712] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:39:13 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:39:14.201920 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-24ef140a-1717-4533-9fcd-e4dd0d19f293 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:14.201920 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-24ef140a-1717-4533-9fcd-e4dd0d19f293 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: ae770112-a153-4fc8-97ea-637cd10d7024] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:14.203768 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-24ef140a-1717-4533-9fcd-e4dd0d19f293 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:14.204282 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-24ef140a-1717-4533-9fcd-e4dd0d19f293 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:14.204720 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-24ef140a-1717-4533-9fcd-e4dd0d19f293 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:14.205502 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-24ef140a-1717-4533-9fcd-e4dd0d19f293 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:14.206200 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-24ef140a-1717-4533-9fcd-e4dd0d19f293 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:14.206625 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-24ef140a-1717-4533-9fcd-e4dd0d19f293 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:14.336275 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-aa54aad9-6f55-4986-a53e-937a0ed11d1a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:14.336890 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-aa54aad9-6f55-4986-a53e-937a0ed11d1a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: c07ab9eb-c1e1-4751-be52-6af1da8790e5] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:14.339678 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-24ef140a-1717-4533-9fcd-e4dd0d19f293 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:14.343718 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-aa54aad9-6f55-4986-a53e-937a0ed11d1a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:14.344470 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-aa54aad9-6f55-4986-a53e-937a0ed11d1a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:14.345805 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-aa54aad9-6f55-4986-a53e-937a0ed11d1a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:14.346669 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-aa54aad9-6f55-4986-a53e-937a0ed11d1a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:14.347270 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-aa54aad9-6f55-4986-a53e-937a0ed11d1a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:14.348121 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-aa54aad9-6f55-4986-a53e-937a0ed11d1a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:14.356334 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-24ef140a-1717-4533-9fcd-e4dd0d19f293 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024" status: 200 len: 1672 microversion: 2.1 time: 0.163384 Aug 10 11:39:14.359387 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 357/713] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:39:14 2022] GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024 => generated 1672 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:39:14.418049 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-aa54aad9-6f55-4986-a53e-937a0ed11d1a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:14.426000 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-aa54aad9-6f55-4986-a53e-937a0ed11d1a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/c07ab9eb-c1e1-4751-be52-6af1da8790e5" status: 200 len: 1145 microversion: 2.1 time: 0.093611 Aug 10 11:39:14.426570 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 357/714] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:39:14 2022] GET /compute/v2.1/servers/c07ab9eb-c1e1-4751-be52-6af1da8790e5 => generated 1145 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:39:14.686661 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-5bfbd50a-e6af-4fd6-96c0-909a15a2d608 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:14.687271 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-5bfbd50a-e6af-4fd6-96c0-909a15a2d608 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:14.694714 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5bfbd50a-e6af-4fd6-96c0-909a15a2d608 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:14.695196 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5bfbd50a-e6af-4fd6-96c0-909a15a2d608 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:14.695631 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5bfbd50a-e6af-4fd6-96c0-909a15a2d608 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:14.696352 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5bfbd50a-e6af-4fd6-96c0-909a15a2d608 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:14.696804 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5bfbd50a-e6af-4fd6-96c0-909a15a2d608 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:14.697221 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5bfbd50a-e6af-4fd6-96c0-909a15a2d608 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:14.835605 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-5bfbd50a-e6af-4fd6-96c0-909a15a2d608 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:14.843594 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-5bfbd50a-e6af-4fd6-96c0-909a15a2d608 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:14.845623 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-5bfbd50a-e6af-4fd6-96c0-909a15a2d608 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:14.846830 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-5bfbd50a-e6af-4fd6-96c0-909a15a2d608 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1730 microversion: 2.20 time: 0.164030 Aug 10 11:39:14.847521 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 358/715] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:39:14 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:39:15.381093 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-b89563b6-8000-46f4-a157-23306fa41b58 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:15.382381 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-b89563b6-8000-46f4-a157-23306fa41b58 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: ae770112-a153-4fc8-97ea-637cd10d7024] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:15.389561 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b89563b6-8000-46f4-a157-23306fa41b58 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:15.390387 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b89563b6-8000-46f4-a157-23306fa41b58 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:15.390883 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b89563b6-8000-46f4-a157-23306fa41b58 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:15.391827 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b89563b6-8000-46f4-a157-23306fa41b58 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:15.392538 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b89563b6-8000-46f4-a157-23306fa41b58 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:15.393153 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b89563b6-8000-46f4-a157-23306fa41b58 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:15.447710 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-2666e768-ee02-4254-911f-7c00949626ab tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:15.448566 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-2666e768-ee02-4254-911f-7c00949626ab tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: c07ab9eb-c1e1-4751-be52-6af1da8790e5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:15.456075 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2666e768-ee02-4254-911f-7c00949626ab tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:15.456573 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2666e768-ee02-4254-911f-7c00949626ab tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:15.457020 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2666e768-ee02-4254-911f-7c00949626ab tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:15.458040 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2666e768-ee02-4254-911f-7c00949626ab tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:15.458917 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2666e768-ee02-4254-911f-7c00949626ab tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:15.459356 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2666e768-ee02-4254-911f-7c00949626ab tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:15.538915 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-2666e768-ee02-4254-911f-7c00949626ab tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:15.555202 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-2666e768-ee02-4254-911f-7c00949626ab tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/c07ab9eb-c1e1-4751-be52-6af1da8790e5" status: 200 len: 1193 microversion: 2.1 time: 0.111969 Aug 10 11:39:15.555612 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 359/716] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:39:15 2022] GET /compute/v2.1/servers/c07ab9eb-c1e1-4751-be52-6af1da8790e5 => generated 1193 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:39:15.620326 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b89563b6-8000-46f4-a157-23306fa41b58 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:15.629451 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-b89563b6-8000-46f4-a157-23306fa41b58 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024" status: 200 len: 1672 microversion: 2.1 time: 0.254076 Aug 10 11:39:15.630037 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 358/717] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:39:15 2022] GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024 => generated 1672 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:39:15.861326 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-1a724c06-2e9e-46ca-88e0-914d6b871f9e req-bc98729e-71f5-4cbf-a26f-9b1f2aa3c153 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae770112-a153-4fc8-97ea-637cd10d7024", "name": "network-vif-deleted", "tag": "c38a855d-5851-489c-ad2f-d32c8362217b"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:39:15.869483 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-8b9f711d-7fbd-4b93-9a3a-7c8121a0dc3b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:15.870369 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-8b9f711d-7fbd-4b93-9a3a-7c8121a0dc3b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:15.878997 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8b9f711d-7fbd-4b93-9a3a-7c8121a0dc3b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:15.879498 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8b9f711d-7fbd-4b93-9a3a-7c8121a0dc3b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:15.879941 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8b9f711d-7fbd-4b93-9a3a-7c8121a0dc3b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:15.880683 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8b9f711d-7fbd-4b93-9a3a-7c8121a0dc3b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:15.881142 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8b9f711d-7fbd-4b93-9a3a-7c8121a0dc3b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:15.883241 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-1a724c06-2e9e-46ca-88e0-914d6b871f9e req-bc98729e-71f5-4cbf-a26f-9b1f2aa3c153 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:15.883836 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-1a724c06-2e9e-46ca-88e0-914d6b871f9e req-bc98729e-71f5-4cbf-a26f-9b1f2aa3c153 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:15.883989 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8b9f711d-7fbd-4b93-9a3a-7c8121a0dc3b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:15.884488 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-1a724c06-2e9e-46ca-88e0-914d6b871f9e req-bc98729e-71f5-4cbf-a26f-9b1f2aa3c153 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:15.902825 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-1a724c06-2e9e-46ca-88e0-914d6b871f9e req-bc98729e-71f5-4cbf-a26f-9b1f2aa3c153 service nova] Creating event network-vif-deleted:c38a855d-5851-489c-ad2f-d32c8362217b for instance ae770112-a153-4fc8-97ea-637cd10d7024 on hv-cinder-85272 Aug 10 11:39:15.909134 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-1a724c06-2e9e-46ca-88e0-914d6b871f9e req-bc98729e-71f5-4cbf-a26f-9b1f2aa3c153 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052119 Aug 10 11:39:15.913343 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 360/718] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:39:16.111571 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-8b9f711d-7fbd-4b93-9a3a-7c8121a0dc3b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:16.122685 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-8b9f711d-7fbd-4b93-9a3a-7c8121a0dc3b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:16.124717 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-8b9f711d-7fbd-4b93-9a3a-7c8121a0dc3b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:16.131838 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-8b9f711d-7fbd-4b93-9a3a-7c8121a0dc3b tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1730 microversion: 2.20 time: 0.262111 Aug 10 11:39:16.131838 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 359/719] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:39:15 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1730 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:39:16.593784 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-dac12352-3390-4663-8362-476206a2a375 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:16.595199 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-dac12352-3390-4663-8362-476206a2a375 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: c07ab9eb-c1e1-4751-be52-6af1da8790e5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:16.602475 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-dac12352-3390-4663-8362-476206a2a375 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:16.603335 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-dac12352-3390-4663-8362-476206a2a375 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:16.604028 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-dac12352-3390-4663-8362-476206a2a375 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:16.605051 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-dac12352-3390-4663-8362-476206a2a375 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:16.605708 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-dac12352-3390-4663-8362-476206a2a375 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:16.606345 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-dac12352-3390-4663-8362-476206a2a375 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:16.653752 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-ede1f6fc-69ff-4bb9-9700-9b9d8e8b5173 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:16.655208 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-ede1f6fc-69ff-4bb9-9700-9b9d8e8b5173 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: ae770112-a153-4fc8-97ea-637cd10d7024] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:16.663785 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ede1f6fc-69ff-4bb9-9700-9b9d8e8b5173 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:16.664878 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ede1f6fc-69ff-4bb9-9700-9b9d8e8b5173 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:16.665715 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ede1f6fc-69ff-4bb9-9700-9b9d8e8b5173 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:16.666735 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ede1f6fc-69ff-4bb9-9700-9b9d8e8b5173 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:16.667418 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ede1f6fc-69ff-4bb9-9700-9b9d8e8b5173 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:16.668136 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ede1f6fc-69ff-4bb9-9700-9b9d8e8b5173 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:16.718130 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ede1f6fc-69ff-4bb9-9700-9b9d8e8b5173 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:16.720624 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ede1f6fc-69ff-4bb9-9700-9b9d8e8b5173 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:16.721140 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ede1f6fc-69ff-4bb9-9700-9b9d8e8b5173 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:16.721620 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.objects.instance [None req-ede1f6fc-69ff-4bb9-9700-9b9d8e8b5173 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lazy-loading 'fault' on Instance uuid ae770112-a153-4fc8-97ea-637cd10d7024 {{(pid=124682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:39:16.739909 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-dac12352-3390-4663-8362-476206a2a375 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:16.749472 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-dac12352-3390-4663-8362-476206a2a375 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/c07ab9eb-c1e1-4751-be52-6af1da8790e5" status: 200 len: 1211 microversion: 2.1 time: 0.170656 Aug 10 11:39:16.751296 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 361/720] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:39:16 2022] GET /compute/v2.1/servers/c07ab9eb-c1e1-4751-be52-6af1da8790e5 => generated 1211 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:39:16.833005 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-ede1f6fc-69ff-4bb9-9700-9b9d8e8b5173 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a528c05e8294590a0b9c1227593276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad65fe5d6c49bfad958684f6a79c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:16.845729 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-ede1f6fc-69ff-4bb9-9700-9b9d8e8b5173 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024" status: 200 len: 1326 microversion: 2.1 time: 0.196690 Aug 10 11:39:16.862050 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 360/721] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:39:16 2022] GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024 => generated 1326 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:39:17.152806 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-7a539898-9b7b-43a2-bb78-6d8b88b06553 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:17.153604 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-7a539898-9b7b-43a2-bb78-6d8b88b06553 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:17.160636 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7a539898-9b7b-43a2-bb78-6d8b88b06553 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:17.161871 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7a539898-9b7b-43a2-bb78-6d8b88b06553 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:17.162307 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7a539898-9b7b-43a2-bb78-6d8b88b06553 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:17.163130 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7a539898-9b7b-43a2-bb78-6d8b88b06553 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:17.163829 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7a539898-9b7b-43a2-bb78-6d8b88b06553 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:17.164298 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7a539898-9b7b-43a2-bb78-6d8b88b06553 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:17.315096 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-7a539898-9b7b-43a2-bb78-6d8b88b06553 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:17.322942 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-7a539898-9b7b-43a2-bb78-6d8b88b06553 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:17.324444 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-7a539898-9b7b-43a2-bb78-6d8b88b06553 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:17.325854 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-7a539898-9b7b-43a2-bb78-6d8b88b06553 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1717 microversion: 2.20 time: 0.178474 Aug 10 11:39:17.326575 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 362/722] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:39:17 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1717 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:39:17.774050 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-8ad21402-c5f4-4339-ae3e-e588ce41ee29 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:17.775528 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-8ad21402-c5f4-4339-ae3e-e588ce41ee29 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: c07ab9eb-c1e1-4751-be52-6af1da8790e5] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:17.783369 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8ad21402-c5f4-4339-ae3e-e588ce41ee29 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:17.784202 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8ad21402-c5f4-4339-ae3e-e588ce41ee29 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:17.784924 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8ad21402-c5f4-4339-ae3e-e588ce41ee29 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:17.785810 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8ad21402-c5f4-4339-ae3e-e588ce41ee29 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:17.786429 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8ad21402-c5f4-4339-ae3e-e588ce41ee29 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:17.786854 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8ad21402-c5f4-4339-ae3e-e588ce41ee29 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:17.869635 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-40fcadbe-8fe6-4262-8dc9-2f9e0664424b tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:17.871001 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-40fcadbe-8fe6-4262-8dc9-2f9e0664424b tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: ae770112-a153-4fc8-97ea-637cd10d7024] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:17.881128 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-40fcadbe-8fe6-4262-8dc9-2f9e0664424b tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:17.882016 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-40fcadbe-8fe6-4262-8dc9-2f9e0664424b tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:17.882519 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-40fcadbe-8fe6-4262-8dc9-2f9e0664424b tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:17.883441 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-40fcadbe-8fe6-4262-8dc9-2f9e0664424b tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:17.890951 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-40fcadbe-8fe6-4262-8dc9-2f9e0664424b tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:17.890951 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-40fcadbe-8fe6-4262-8dc9-2f9e0664424b tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:17.902097 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-40fcadbe-8fe6-4262-8dc9-2f9e0664424b tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] HTTP exception thrown: Instance ae770112-a153-4fc8-97ea-637cd10d7024 could not be found. Aug 10 11:39:17.904241 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-40fcadbe-8fe6-4262-8dc9-2f9e0664424b tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Request method failure captured: Aug 10 11:39:17.904241 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: request: GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024 HTTP/1.1 Aug 10 11:39:17.904241 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept: application/json Aug 10 11:39:17.904241 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Aug 10 11:39:17.904241 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Connection: close Aug 10 11:39:17.904241 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Length: 0 Aug 10 11:39:17.904241 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Type: application/json Aug 10 11:39:17.904241 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Host: 10.222.0.62 Aug 10 11:39:17.904241 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Aug 10 11:39:17.904241 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.11 Aug 10 11:39:17.904241 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABi85dfIpriryLbB59GELPFg4XM5K1wh_3EUPq0KMWNK2G4JDFL74K5NjEJKks5wfyj8ACGp3JhfD-7BS8lBdkX3qlM8v99bkHvzzzR-2qPhECz_z7426PKHOsTP8ypAQtnaQfBZprrSi9ZvF3u7dpLOpLd6-8hSvMhHuKJ0XIbTku4vfA Aug 10 11:39:17.904241 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Aug 10 11:39:17.904241 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Aug 10 11:39:17.904241 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Aug 10 11:39:17.904241 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Aug 10 11:39:17.904241 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Aug 10 11:39:17.904241 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Aug 10 11:39:17.904241 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Id: 1aad65fe5d6c49bfad958684f6a79c22 Aug 10 11:39:17.904241 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-AttachVolumeTestJSON-214789268 Aug 10 11:39:17.904241 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Role: member,reader Aug 10 11:39:17.904241 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Aug 10 11:39:17.905930 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1aad65fe5d6c49bfad958684f6a79c22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1aad65fe5d6c49bfad958684f6a79c22", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1aad65fe5d6c49bfad958684f6a79c22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1aad65fe5d6c49bfad958684f6a79c22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:39:17.905930 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-AttachVolumeTestJSON-214789268 Aug 10 11:39:17.905930 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Id: 1aad65fe5d6c49bfad958684f6a79c22 Aug 10 11:39:17.905930 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-AttachVolumeTestJSON-214789268 Aug 10 11:39:17.905930 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User: tempest-AttachVolumeTestJSON-214789268-project Aug 10 11:39:17.905930 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Aug 10 11:39:17.905930 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Aug 10 11:39:17.905930 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Id: 2a528c05e8294590a0b9c1227593276f Aug 10 11:39:17.905930 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-AttachVolumeTestJSON-214789268-project Aug 10 11:39:17.905930 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: method: > Aug 10 11:39:17.905930 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: exception: Instance ae770112-a153-4fc8-97ea-637cd10d7024 could not be found. Aug 10 11:39:17.905930 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: action_args: {'id': 'ae770112-a153-4fc8-97ea-637cd10d7024'} Aug 10 11:39:17.906938 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:39:17.906938 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:39:17.906938 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:39:17.906938 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:39:17.906938 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:39:17.906938 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:39:17.906938 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:39:17.906938 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:39:17.906938 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:39:17.906938 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:39:17.906938 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae770112-a153-4fc8-97ea-637cd10d7024 could not be found. Aug 10 11:39:17.906938 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:39:17.906938 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:39:17.906938 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:39:17.906938 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:39:17.906938 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:39:17.906938 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:39:17.906938 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:39:17.906938 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:39:17.906938 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:39:17.910140 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:39:17.910140 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:39:17.910140 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:39:17.910140 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:39:17.910140 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:39:17.910140 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:39:17.910140 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:39:17.910140 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae770112-a153-4fc8-97ea-637cd10d7024 could not be found. Aug 10 11:39:17.910140 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:39:17.910140 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:39:17.910140 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:39:17.910140 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:39:17.910140 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:39:17.910140 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:39:17.910140 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:39:17.910140 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:39:17.910140 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae770112-a153-4fc8-97ea-637cd10d7024 could not be found. Aug 10 11:39:17.910140 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:39:17.911879 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-40fcadbe-8fe6-4262-8dc9-2f9e0664424b tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Returning 404 to user: Instance ae770112-a153-4fc8-97ea-637cd10d7024 could not be found. {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:39:17.911879 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-40fcadbe-8fe6-4262-8dc9-2f9e0664424b tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024" status: 404 len: 111 microversion: 2.1 time: 0.041809 Aug 10 11:39:17.913363 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 363/723] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:39:17 2022] GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 11:39:17.918446 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-bd6d9984-8931-4c05-b31c-c0b3b4280a24 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '.version_select at 0x7fb7cdcad310>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:17.992793 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-bd6d9984-8931-4c05-b31c-c0b3b4280a24 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-518138461" status: 202 len: 0 microversion: 2.1 time: 0.079247 Aug 10 11:39:17.993597 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 364/724] 10.222.0.62 () {58 vars in 1218 bytes} [Wed Aug 10 11:39:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-518138461 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:39:18.005427 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-8ad21402-c5f4-4339-ae3e-e588ce41ee29 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:18.015765 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-8ad21402-c5f4-4339-ae3e-e588ce41ee29 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/c07ab9eb-c1e1-4751-be52-6af1da8790e5" status: 200 len: 1279 microversion: 2.1 time: 0.246163 Aug 10 11:39:18.016445 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 361/725] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:39:17 2022] GET /compute/v2.1/servers/c07ab9eb-c1e1-4751-be52-6af1da8790e5 => generated 1279 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:39:18.382460 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-934e943c-d3d0-4079-9689-673a526a54a2 req-dfb7779c-4940-4fd0-82fc-bc5cc341353a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c07ab9eb-c1e1-4751-be52-6af1da8790e5", "tag": "49f146b4-6b29-4027-95c8-23b108907bed"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:39:18.401976 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-934e943c-d3d0-4079-9689-673a526a54a2 req-dfb7779c-4940-4fd0-82fc-bc5cc341353a service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:18.403292 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-934e943c-d3d0-4079-9689-673a526a54a2 req-dfb7779c-4940-4fd0-82fc-bc5cc341353a service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:18.404186 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-934e943c-d3d0-4079-9689-673a526a54a2 req-dfb7779c-4940-4fd0-82fc-bc5cc341353a service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:18.440075 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-934e943c-d3d0-4079-9689-673a526a54a2 req-dfb7779c-4940-4fd0-82fc-bc5cc341353a service nova] Creating event network-changed:49f146b4-6b29-4027-95c8-23b108907bed for instance c07ab9eb-c1e1-4751-be52-6af1da8790e5 on hv-cinder-85272 Aug 10 11:39:18.448449 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-934e943c-d3d0-4079-9689-673a526a54a2 req-dfb7779c-4940-4fd0-82fc-bc5cc341353a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074361 Aug 10 11:39:18.450035 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 365/726] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:39:19.037391 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-9717361d-eb83-4ba8-bf1e-6cc264f3f82e tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:19.038101 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-9717361d-eb83-4ba8-bf1e-6cc264f3f82e tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: c07ab9eb-c1e1-4751-be52-6af1da8790e5] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:19.044930 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9717361d-eb83-4ba8-bf1e-6cc264f3f82e tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:19.045414 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9717361d-eb83-4ba8-bf1e-6cc264f3f82e tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:19.045848 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9717361d-eb83-4ba8-bf1e-6cc264f3f82e tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:19.046776 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9717361d-eb83-4ba8-bf1e-6cc264f3f82e tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:19.047516 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9717361d-eb83-4ba8-bf1e-6cc264f3f82e tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:19.047936 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9717361d-eb83-4ba8-bf1e-6cc264f3f82e tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:19.258709 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-9717361d-eb83-4ba8-bf1e-6cc264f3f82e tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:19.266999 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-9717361d-eb83-4ba8-bf1e-6cc264f3f82e tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/c07ab9eb-c1e1-4751-be52-6af1da8790e5" status: 200 len: 1267 microversion: 2.1 time: 0.233196 Aug 10 11:39:19.267840 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 362/727] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:39:19 2022] GET /compute/v2.1/servers/c07ab9eb-c1e1-4751-be52-6af1da8790e5 => generated 1267 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:39:20.288108 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-fec26033-da38-4f79-8c1d-92d1f7a985f7 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:20.288813 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-fec26033-da38-4f79-8c1d-92d1f7a985f7 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: c07ab9eb-c1e1-4751-be52-6af1da8790e5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:20.296032 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fec26033-da38-4f79-8c1d-92d1f7a985f7 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:20.296532 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fec26033-da38-4f79-8c1d-92d1f7a985f7 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:20.296973 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fec26033-da38-4f79-8c1d-92d1f7a985f7 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:20.297742 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fec26033-da38-4f79-8c1d-92d1f7a985f7 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:20.298463 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fec26033-da38-4f79-8c1d-92d1f7a985f7 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:20.298959 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fec26033-da38-4f79-8c1d-92d1f7a985f7 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:20.434400 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-fec26033-da38-4f79-8c1d-92d1f7a985f7 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:20.442246 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-fec26033-da38-4f79-8c1d-92d1f7a985f7 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/c07ab9eb-c1e1-4751-be52-6af1da8790e5" status: 200 len: 1267 microversion: 2.1 time: 0.158504 Aug 10 11:39:20.442820 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 366/728] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:39:20 2022] GET /compute/v2.1/servers/c07ab9eb-c1e1-4751-be52-6af1da8790e5 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:39:21.336968 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-1a64c16d-35a4-435d-a1ac-a452559ba4a6 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:21.337455 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-1a64c16d-35a4-435d-a1ac-a452559ba4a6 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: ae770112-a153-4fc8-97ea-637cd10d7024] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:21.339932 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:39:21.345185 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1a64c16d-35a4-435d-a1ac-a452559ba4a6 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:21.345671 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1a64c16d-35a4-435d-a1ac-a452559ba4a6 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:21.346109 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1a64c16d-35a4-435d-a1ac-a452559ba4a6 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:21.346806 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1a64c16d-35a4-435d-a1ac-a452559ba4a6 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:21.347301 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1a64c16d-35a4-435d-a1ac-a452559ba4a6 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:21.347906 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1a64c16d-35a4-435d-a1ac-a452559ba4a6 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:21.362788 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.wsgi [None req-1a64c16d-35a4-435d-a1ac-a452559ba4a6 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] HTTP exception thrown: Instance ae770112-a153-4fc8-97ea-637cd10d7024 could not be found. Aug 10 11:39:21.364505 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-1a64c16d-35a4-435d-a1ac-a452559ba4a6 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Request method failure captured: Aug 10 11:39:21.364505 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: request: DELETE /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024 HTTP/1.1 Aug 10 11:39:21.364505 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Accept: application/json Aug 10 11:39:21.364505 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Aug 10 11:39:21.364505 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Connection: close Aug 10 11:39:21.364505 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Content-Length: 0 Aug 10 11:39:21.364505 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Content-Type: application/json Aug 10 11:39:21.364505 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Host: 10.222.0.62 Aug 10 11:39:21.364505 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Aug 10 11:39:21.364505 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.11 Aug 10 11:39:21.364505 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABi85dfIpriryLbB59GELPFg4XM5K1wh_3EUPq0KMWNK2G4JDFL74K5NjEJKks5wfyj8ACGp3JhfD-7BS8lBdkX3qlM8v99bkHvzzzR-2qPhECz_z7426PKHOsTP8ypAQtnaQfBZprrSi9ZvF3u7dpLOpLd6-8hSvMhHuKJ0XIbTku4vfA Aug 10 11:39:21.364505 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Aug 10 11:39:21.364505 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Aug 10 11:39:21.364505 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Aug 10 11:39:21.364505 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Aug 10 11:39:21.364505 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Aug 10 11:39:21.364505 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Aug 10 11:39:21.364505 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Id: 1aad65fe5d6c49bfad958684f6a79c22 Aug 10 11:39:21.364505 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-AttachVolumeTestJSON-214789268 Aug 10 11:39:21.364505 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Role: member,reader Aug 10 11:39:21.364505 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Aug 10 11:39:21.366169 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1aad65fe5d6c49bfad958684f6a79c22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1aad65fe5d6c49bfad958684f6a79c22", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1aad65fe5d6c49bfad958684f6a79c22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1aad65fe5d6c49bfad958684f6a79c22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:39:21.366169 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-AttachVolumeTestJSON-214789268 Aug 10 11:39:21.366169 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant-Id: 1aad65fe5d6c49bfad958684f6a79c22 Aug 10 11:39:21.366169 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-AttachVolumeTestJSON-214789268 Aug 10 11:39:21.366169 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User: tempest-AttachVolumeTestJSON-214789268-project Aug 10 11:39:21.366169 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Aug 10 11:39:21.366169 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Aug 10 11:39:21.366169 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Id: 2a528c05e8294590a0b9c1227593276f Aug 10 11:39:21.366169 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-AttachVolumeTestJSON-214789268-project Aug 10 11:39:21.366169 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: method: > Aug 10 11:39:21.366169 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: exception: Instance ae770112-a153-4fc8-97ea-637cd10d7024 could not be found. Aug 10 11:39:21.366169 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: action_args: {'id': 'ae770112-a153-4fc8-97ea-637cd10d7024'} Aug 10 11:39:21.367420 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:39:21.367420 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:39:21.367420 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:39:21.367420 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:39:21.367420 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:39:21.367420 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:39:21.367420 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:39:21.367420 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:39:21.367420 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:39:21.367420 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:39:21.367420 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae770112-a153-4fc8-97ea-637cd10d7024 could not be found. Aug 10 11:39:21.367420 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:39:21.367420 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:39:21.367420 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:39:21.367420 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:39:21.367420 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:39:21.367420 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:39:21.367420 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:39:21.367420 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:39:21.367420 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:39:21.369012 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:39:21.369012 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 11:39:21.369012 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 11:39:21.369012 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 11:39:21.369012 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 11:39:21.369012 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:39:21.369012 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:39:21.369012 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:39:21.369012 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:39:21.369012 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae770112-a153-4fc8-97ea-637cd10d7024 could not be found. Aug 10 11:39:21.369012 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:39:21.369012 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:39:21.369012 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:39:21.369012 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:39:21.369012 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:39:21.369012 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:39:21.369012 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:39:21.369012 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:39:21.369012 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae770112-a153-4fc8-97ea-637cd10d7024 could not be found. Aug 10 11:39:21.369012 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:39:21.370841 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-1a64c16d-35a4-435d-a1ac-a452559ba4a6 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Returning 404 to user: Instance ae770112-a153-4fc8-97ea-637cd10d7024 could not be found. {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:39:21.370841 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-1a64c16d-35a4-435d-a1ac-a452559ba4a6 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "DELETE /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024" status: 404 len: 111 microversion: 2.1 time: 0.032749 Aug 10 11:39:21.370841 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 363/729] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 10 11:39:21 2022] DELETE /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:39:21.374282 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-300470ef-f42e-4f6b-8f54-73d3b09d5744 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:21.374890 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-300470ef-f42e-4f6b-8f54-73d3b09d5744 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: ae770112-a153-4fc8-97ea-637cd10d7024] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:21.382616 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-300470ef-f42e-4f6b-8f54-73d3b09d5744 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:21.383192 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-300470ef-f42e-4f6b-8f54-73d3b09d5744 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:21.383701 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-300470ef-f42e-4f6b-8f54-73d3b09d5744 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:21.384561 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-300470ef-f42e-4f6b-8f54-73d3b09d5744 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:21.385090 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-300470ef-f42e-4f6b-8f54-73d3b09d5744 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:21.385621 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-300470ef-f42e-4f6b-8f54-73d3b09d5744 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:21.400624 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-300470ef-f42e-4f6b-8f54-73d3b09d5744 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] HTTP exception thrown: Instance ae770112-a153-4fc8-97ea-637cd10d7024 could not be found. Aug 10 11:39:21.402290 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-300470ef-f42e-4f6b-8f54-73d3b09d5744 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Request method failure captured: Aug 10 11:39:21.402290 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: request: GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024 HTTP/1.1 Aug 10 11:39:21.402290 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept: application/json Aug 10 11:39:21.402290 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Aug 10 11:39:21.402290 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Connection: close Aug 10 11:39:21.402290 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Length: 0 Aug 10 11:39:21.402290 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Type: application/json Aug 10 11:39:21.402290 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Host: 10.222.0.62 Aug 10 11:39:21.402290 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Aug 10 11:39:21.402290 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.11 Aug 10 11:39:21.402290 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABi85dfIpriryLbB59GELPFg4XM5K1wh_3EUPq0KMWNK2G4JDFL74K5NjEJKks5wfyj8ACGp3JhfD-7BS8lBdkX3qlM8v99bkHvzzzR-2qPhECz_z7426PKHOsTP8ypAQtnaQfBZprrSi9ZvF3u7dpLOpLd6-8hSvMhHuKJ0XIbTku4vfA Aug 10 11:39:21.402290 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Aug 10 11:39:21.402290 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Aug 10 11:39:21.402290 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Aug 10 11:39:21.402290 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Aug 10 11:39:21.402290 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Aug 10 11:39:21.402290 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Aug 10 11:39:21.402290 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Id: 1aad65fe5d6c49bfad958684f6a79c22 Aug 10 11:39:21.402290 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-AttachVolumeTestJSON-214789268 Aug 10 11:39:21.402290 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Role: member,reader Aug 10 11:39:21.402290 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Aug 10 11:39:21.403927 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1aad65fe5d6c49bfad958684f6a79c22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1aad65fe5d6c49bfad958684f6a79c22", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1aad65fe5d6c49bfad958684f6a79c22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1aad65fe5d6c49bfad958684f6a79c22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:39:21.403927 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-AttachVolumeTestJSON-214789268 Aug 10 11:39:21.403927 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Id: 1aad65fe5d6c49bfad958684f6a79c22 Aug 10 11:39:21.403927 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-AttachVolumeTestJSON-214789268 Aug 10 11:39:21.403927 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User: tempest-AttachVolumeTestJSON-214789268-project Aug 10 11:39:21.403927 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Aug 10 11:39:21.403927 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Aug 10 11:39:21.403927 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Id: 2a528c05e8294590a0b9c1227593276f Aug 10 11:39:21.403927 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-AttachVolumeTestJSON-214789268-project Aug 10 11:39:21.403927 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: method: > Aug 10 11:39:21.403927 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: exception: Instance ae770112-a153-4fc8-97ea-637cd10d7024 could not be found. Aug 10 11:39:21.403927 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: action_args: {'id': 'ae770112-a153-4fc8-97ea-637cd10d7024'} Aug 10 11:39:21.404875 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:39:21.404875 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:39:21.404875 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:39:21.404875 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:39:21.404875 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:39:21.404875 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:39:21.404875 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:39:21.404875 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:39:21.404875 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:39:21.404875 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:39:21.404875 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae770112-a153-4fc8-97ea-637cd10d7024 could not be found. Aug 10 11:39:21.404875 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:39:21.404875 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:39:21.404875 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:39:21.404875 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:39:21.404875 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:39:21.404875 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:39:21.404875 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:39:21.404875 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:39:21.404875 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:39:21.406307 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:39:21.406307 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:39:21.406307 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:39:21.406307 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:39:21.406307 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:39:21.406307 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:39:21.406307 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:39:21.406307 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae770112-a153-4fc8-97ea-637cd10d7024 could not be found. Aug 10 11:39:21.406307 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:39:21.406307 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:39:21.406307 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:39:21.406307 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:39:21.406307 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:39:21.406307 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:39:21.406307 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:39:21.406307 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:39:21.406307 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae770112-a153-4fc8-97ea-637cd10d7024 could not be found. Aug 10 11:39:21.406307 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:39:21.407907 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-300470ef-f42e-4f6b-8f54-73d3b09d5744 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Returning 404 to user: Instance ae770112-a153-4fc8-97ea-637cd10d7024 could not be found. {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:39:21.407907 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-300470ef-f42e-4f6b-8f54-73d3b09d5744 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024" status: 404 len: 111 microversion: 2.1 time: 0.033154 Aug 10 11:39:21.410100 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 367/730] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:39:21 2022] GET /compute/v2.1/servers/ae770112-a153-4fc8-97ea-637cd10d7024 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 11:39:21.463048 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-86ed46a9-2e18-4356-a554-0566beb23d94 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:21.463727 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-86ed46a9-2e18-4356-a554-0566beb23d94 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: c07ab9eb-c1e1-4751-be52-6af1da8790e5] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:21.471560 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-86ed46a9-2e18-4356-a554-0566beb23d94 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:21.472080 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-86ed46a9-2e18-4356-a554-0566beb23d94 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:21.472549 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-86ed46a9-2e18-4356-a554-0566beb23d94 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:21.473251 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-86ed46a9-2e18-4356-a554-0566beb23d94 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:21.473707 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-86ed46a9-2e18-4356-a554-0566beb23d94 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:21.474136 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-86ed46a9-2e18-4356-a554-0566beb23d94 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:21.614066 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-86ed46a9-2e18-4356-a554-0566beb23d94 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:21.633858 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-86ed46a9-2e18-4356-a554-0566beb23d94 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/c07ab9eb-c1e1-4751-be52-6af1da8790e5" status: 200 len: 1267 microversion: 2.1 time: 0.162590 Aug 10 11:39:21.633858 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 364/731] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:39:21 2022] GET /compute/v2.1/servers/c07ab9eb-c1e1-4751-be52-6af1da8790e5 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:39:22.643240 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-311db21d-a610-4036-b107-ce20f1834d6e tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:22.643742 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-311db21d-a610-4036-b107-ce20f1834d6e tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: c07ab9eb-c1e1-4751-be52-6af1da8790e5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:22.646724 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=2 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:39:22.647399 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=6 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:39:22.651310 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-311db21d-a610-4036-b107-ce20f1834d6e tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:22.651795 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-311db21d-a610-4036-b107-ce20f1834d6e tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:22.652263 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-311db21d-a610-4036-b107-ce20f1834d6e tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:22.652970 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-311db21d-a610-4036-b107-ce20f1834d6e tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:22.653427 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-311db21d-a610-4036-b107-ce20f1834d6e tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:22.653861 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-311db21d-a610-4036-b107-ce20f1834d6e tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:22.664565 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-d1d73c68-4dba-4546-bb21-72d66c8f313c tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:22.665052 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-d1d73c68-4dba-4546-bb21-72d66c8f313c tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:22.667019 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=2 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:39:22.672311 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d1d73c68-4dba-4546-bb21-72d66c8f313c tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:22.673304 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d1d73c68-4dba-4546-bb21-72d66c8f313c tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:22.673757 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d1d73c68-4dba-4546-bb21-72d66c8f313c tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:22.674456 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d1d73c68-4dba-4546-bb21-72d66c8f313c tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:22.675041 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d1d73c68-4dba-4546-bb21-72d66c8f313c tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:22.675532 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d1d73c68-4dba-4546-bb21-72d66c8f313c tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:22.690305 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.wsgi [None req-d1d73c68-4dba-4546-bb21-72d66c8f313c tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] HTTP exception thrown: Instance 61282604-5de4-413b-be4c-80aadca981b3 could not be found. Aug 10 11:39:22.691886 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-d1d73c68-4dba-4546-bb21-72d66c8f313c tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Request method failure captured: Aug 10 11:39:22.691886 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: request: DELETE /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 HTTP/1.1 Aug 10 11:39:22.691886 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Accept: application/json Aug 10 11:39:22.691886 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Aug 10 11:39:22.691886 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Connection: close Aug 10 11:39:22.691886 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Content-Length: 0 Aug 10 11:39:22.691886 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Content-Type: application/json Aug 10 11:39:22.691886 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Host: 10.222.0.62 Aug 10 11:39:22.691886 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Aug 10 11:39:22.691886 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.11 Aug 10 11:39:22.691886 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABi85dfIpriryLbB59GELPFg4XM5K1wh_3EUPq0KMWNK2G4JDFL74K5NjEJKks5wfyj8ACGp3JhfD-7BS8lBdkX3qlM8v99bkHvzzzR-2qPhECz_z7426PKHOsTP8ypAQtnaQfBZprrSi9ZvF3u7dpLOpLd6-8hSvMhHuKJ0XIbTku4vfA Aug 10 11:39:22.691886 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Aug 10 11:39:22.691886 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Aug 10 11:39:22.691886 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Aug 10 11:39:22.691886 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Aug 10 11:39:22.691886 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Aug 10 11:39:22.691886 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Aug 10 11:39:22.691886 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Id: 1aad65fe5d6c49bfad958684f6a79c22 Aug 10 11:39:22.691886 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-AttachVolumeTestJSON-214789268 Aug 10 11:39:22.691886 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Role: member,reader Aug 10 11:39:22.691886 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Aug 10 11:39:22.693617 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1aad65fe5d6c49bfad958684f6a79c22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1aad65fe5d6c49bfad958684f6a79c22", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1aad65fe5d6c49bfad958684f6a79c22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1aad65fe5d6c49bfad958684f6a79c22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:39:22.693617 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-AttachVolumeTestJSON-214789268 Aug 10 11:39:22.693617 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant-Id: 1aad65fe5d6c49bfad958684f6a79c22 Aug 10 11:39:22.693617 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-AttachVolumeTestJSON-214789268 Aug 10 11:39:22.693617 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User: tempest-AttachVolumeTestJSON-214789268-project Aug 10 11:39:22.693617 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Aug 10 11:39:22.693617 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Aug 10 11:39:22.693617 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Id: 2a528c05e8294590a0b9c1227593276f Aug 10 11:39:22.693617 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-AttachVolumeTestJSON-214789268-project Aug 10 11:39:22.693617 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: method: > Aug 10 11:39:22.693617 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: exception: Instance 61282604-5de4-413b-be4c-80aadca981b3 could not be found. Aug 10 11:39:22.693617 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: action_args: {'id': '61282604-5de4-413b-be4c-80aadca981b3'} Aug 10 11:39:22.694593 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:39:22.694593 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:39:22.694593 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:39:22.694593 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:39:22.694593 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:39:22.694593 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:39:22.694593 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:39:22.694593 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:39:22.694593 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:39:22.694593 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:39:22.694593 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61282604-5de4-413b-be4c-80aadca981b3 could not be found. Aug 10 11:39:22.694593 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:39:22.694593 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:39:22.694593 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:39:22.694593 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:39:22.694593 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:39:22.694593 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:39:22.694593 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:39:22.694593 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:39:22.694593 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:39:22.696079 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:39:22.696079 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 11:39:22.696079 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 11:39:22.696079 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 11:39:22.696079 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 11:39:22.696079 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:39:22.696079 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:39:22.696079 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:39:22.696079 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:39:22.696079 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61282604-5de4-413b-be4c-80aadca981b3 could not be found. Aug 10 11:39:22.696079 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:39:22.696079 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:39:22.696079 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:39:22.696079 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:39:22.696079 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:39:22.696079 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:39:22.696079 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:39:22.696079 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:39:22.696079 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61282604-5de4-413b-be4c-80aadca981b3 could not be found. Aug 10 11:39:22.696079 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:39:22.697624 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-d1d73c68-4dba-4546-bb21-72d66c8f313c tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Returning 404 to user: Instance 61282604-5de4-413b-be4c-80aadca981b3 could not be found. {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:39:22.697624 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-d1d73c68-4dba-4546-bb21-72d66c8f313c tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "DELETE /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 404 len: 111 microversion: 2.1 time: 0.032567 Aug 10 11:39:22.697624 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 365/732] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 10 11:39:22 2022] DELETE /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 11:39:22.701234 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-e596afa6-e7f7-46e7-91a0-9db91d454397 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:22.701844 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-e596afa6-e7f7-46e7-91a0-9db91d454397 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] [instance: 61282604-5de4-413b-be4c-80aadca981b3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:22.708436 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e596afa6-e7f7-46e7-91a0-9db91d454397 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:22.708917 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e596afa6-e7f7-46e7-91a0-9db91d454397 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:22.709354 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e596afa6-e7f7-46e7-91a0-9db91d454397 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:22.710055 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e596afa6-e7f7-46e7-91a0-9db91d454397 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:22.710507 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e596afa6-e7f7-46e7-91a0-9db91d454397 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:22.710931 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e596afa6-e7f7-46e7-91a0-9db91d454397 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:22.724435 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.wsgi [None req-e596afa6-e7f7-46e7-91a0-9db91d454397 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] HTTP exception thrown: Instance 61282604-5de4-413b-be4c-80aadca981b3 could not be found. Aug 10 11:39:22.725969 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-e596afa6-e7f7-46e7-91a0-9db91d454397 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Request method failure captured: Aug 10 11:39:22.725969 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: request: GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 HTTP/1.1 Aug 10 11:39:22.725969 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Accept: application/json Aug 10 11:39:22.725969 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Aug 10 11:39:22.725969 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Connection: close Aug 10 11:39:22.725969 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Content-Length: 0 Aug 10 11:39:22.725969 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Content-Type: application/json Aug 10 11:39:22.725969 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Host: 10.222.0.62 Aug 10 11:39:22.725969 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Aug 10 11:39:22.725969 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.11 Aug 10 11:39:22.725969 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABi85dfIpriryLbB59GELPFg4XM5K1wh_3EUPq0KMWNK2G4JDFL74K5NjEJKks5wfyj8ACGp3JhfD-7BS8lBdkX3qlM8v99bkHvzzzR-2qPhECz_z7426PKHOsTP8ypAQtnaQfBZprrSi9ZvF3u7dpLOpLd6-8hSvMhHuKJ0XIbTku4vfA Aug 10 11:39:22.725969 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Aug 10 11:39:22.725969 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Aug 10 11:39:22.725969 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Aug 10 11:39:22.725969 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Aug 10 11:39:22.725969 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Aug 10 11:39:22.725969 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Aug 10 11:39:22.725969 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Id: 1aad65fe5d6c49bfad958684f6a79c22 Aug 10 11:39:22.725969 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-AttachVolumeTestJSON-214789268 Aug 10 11:39:22.725969 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Role: member,reader Aug 10 11:39:22.725969 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Aug 10 11:39:22.727659 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1aad65fe5d6c49bfad958684f6a79c22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1aad65fe5d6c49bfad958684f6a79c22", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1aad65fe5d6c49bfad958684f6a79c22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1aad65fe5d6c49bfad958684f6a79c22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:39:22.727659 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-AttachVolumeTestJSON-214789268 Aug 10 11:39:22.727659 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant-Id: 1aad65fe5d6c49bfad958684f6a79c22 Aug 10 11:39:22.727659 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-AttachVolumeTestJSON-214789268 Aug 10 11:39:22.727659 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User: tempest-AttachVolumeTestJSON-214789268-project Aug 10 11:39:22.727659 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Aug 10 11:39:22.727659 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Aug 10 11:39:22.727659 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Id: 2a528c05e8294590a0b9c1227593276f Aug 10 11:39:22.727659 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-AttachVolumeTestJSON-214789268-project Aug 10 11:39:22.727659 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: method: > Aug 10 11:39:22.727659 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: exception: Instance 61282604-5de4-413b-be4c-80aadca981b3 could not be found. Aug 10 11:39:22.727659 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: action_args: {'id': '61282604-5de4-413b-be4c-80aadca981b3'} Aug 10 11:39:22.728520 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:39:22.728520 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:39:22.728520 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:39:22.728520 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:39:22.728520 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:39:22.728520 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:39:22.728520 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:39:22.728520 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:39:22.728520 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:39:22.728520 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:39:22.728520 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61282604-5de4-413b-be4c-80aadca981b3 could not be found. Aug 10 11:39:22.728520 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:39:22.728520 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:39:22.728520 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:39:22.728520 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:39:22.728520 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:39:22.728520 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:39:22.728520 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:39:22.728520 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:39:22.728520 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:39:22.730016 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:39:22.730016 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:39:22.730016 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:39:22.730016 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:39:22.730016 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:39:22.730016 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:39:22.730016 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:39:22.730016 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61282604-5de4-413b-be4c-80aadca981b3 could not be found. Aug 10 11:39:22.730016 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:39:22.730016 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:39:22.730016 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:39:22.730016 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:39:22.730016 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:39:22.730016 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:39:22.730016 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:39:22.730016 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:39:22.730016 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61282604-5de4-413b-be4c-80aadca981b3 could not be found. Aug 10 11:39:22.730016 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:39:22.731444 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-e596afa6-e7f7-46e7-91a0-9db91d454397 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] Returning 404 to user: Instance 61282604-5de4-413b-be4c-80aadca981b3 could not be found. {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:39:22.731444 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-e596afa6-e7f7-46e7-91a0-9db91d454397 tempest-AttachVolumeTestJSON-214789268 tempest-AttachVolumeTestJSON-214789268-project] 10.222.0.62 "GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3" status: 404 len: 111 microversion: 2.1 time: 0.029667 Aug 10 11:39:22.731444 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 366/733] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:39:22 2022] GET /compute/v2.1/servers/61282604-5de4-413b-be4c-80aadca981b3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 11:39:22.828292 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-311db21d-a610-4036-b107-ce20f1834d6e tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:22.836445 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-311db21d-a610-4036-b107-ce20f1834d6e tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/c07ab9eb-c1e1-4751-be52-6af1da8790e5" status: 200 len: 1267 microversion: 2.1 time: 0.197808 Aug 10 11:39:22.837013 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 368/734] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:39:22 2022] GET /compute/v2.1/servers/c07ab9eb-c1e1-4751-be52-6af1da8790e5 => generated 1267 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:39:23.861175 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-fa5ec3a2-e0e2-4913-98ad-253ec3d4a4d3 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:23.862126 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-fa5ec3a2-e0e2-4913-98ad-253ec3d4a4d3 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: c07ab9eb-c1e1-4751-be52-6af1da8790e5] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:23.869399 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fa5ec3a2-e0e2-4913-98ad-253ec3d4a4d3 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:23.870093 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fa5ec3a2-e0e2-4913-98ad-253ec3d4a4d3 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:23.871299 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fa5ec3a2-e0e2-4913-98ad-253ec3d4a4d3 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:23.878547 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fa5ec3a2-e0e2-4913-98ad-253ec3d4a4d3 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:23.879399 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fa5ec3a2-e0e2-4913-98ad-253ec3d4a4d3 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:23.880159 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fa5ec3a2-e0e2-4913-98ad-253ec3d4a4d3 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:24.044691 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-fa5ec3a2-e0e2-4913-98ad-253ec3d4a4d3 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:24.053930 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-fa5ec3a2-e0e2-4913-98ad-253ec3d4a4d3 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/c07ab9eb-c1e1-4751-be52-6af1da8790e5" status: 200 len: 1267 microversion: 2.1 time: 0.197253 Aug 10 11:39:24.054432 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 367/735] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:39:23 2022] GET /compute/v2.1/servers/c07ab9eb-c1e1-4751-be52-6af1da8790e5 => generated 1267 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:39:25.074720 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-11ed0622-1a25-41d6-a859-575e83b85c78 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:25.075428 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-11ed0622-1a25-41d6-a859-575e83b85c78 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: c07ab9eb-c1e1-4751-be52-6af1da8790e5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:25.083792 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-11ed0622-1a25-41d6-a859-575e83b85c78 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:25.086640 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-11ed0622-1a25-41d6-a859-575e83b85c78 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:25.086640 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-11ed0622-1a25-41d6-a859-575e83b85c78 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:25.086640 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-11ed0622-1a25-41d6-a859-575e83b85c78 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:25.086640 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-11ed0622-1a25-41d6-a859-575e83b85c78 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:25.087063 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-11ed0622-1a25-41d6-a859-575e83b85c78 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:25.226029 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-11ed0622-1a25-41d6-a859-575e83b85c78 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:25.246594 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-11ed0622-1a25-41d6-a859-575e83b85c78 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/c07ab9eb-c1e1-4751-be52-6af1da8790e5" status: 200 len: 1267 microversion: 2.1 time: 0.175693 Aug 10 11:39:25.251859 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 369/736] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:39:25 2022] GET /compute/v2.1/servers/c07ab9eb-c1e1-4751-be52-6af1da8790e5 => generated 1267 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:39:26.279140 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-91f3c2f9-febb-4f21-8e28-5929d5206a5a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:26.280323 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-91f3c2f9-febb-4f21-8e28-5929d5206a5a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: c07ab9eb-c1e1-4751-be52-6af1da8790e5] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:26.286891 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-91f3c2f9-febb-4f21-8e28-5929d5206a5a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:26.287382 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-91f3c2f9-febb-4f21-8e28-5929d5206a5a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:26.287818 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-91f3c2f9-febb-4f21-8e28-5929d5206a5a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:26.288552 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-91f3c2f9-febb-4f21-8e28-5929d5206a5a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:26.289006 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-91f3c2f9-febb-4f21-8e28-5929d5206a5a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:26.289426 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-91f3c2f9-febb-4f21-8e28-5929d5206a5a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:26.493725 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-91f3c2f9-febb-4f21-8e28-5929d5206a5a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:26.507176 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-91f3c2f9-febb-4f21-8e28-5929d5206a5a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/c07ab9eb-c1e1-4751-be52-6af1da8790e5" status: 200 len: 1267 microversion: 2.1 time: 0.231315 Aug 10 11:39:26.509295 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 368/737] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:39:26 2022] GET /compute/v2.1/servers/c07ab9eb-c1e1-4751-be52-6af1da8790e5 => generated 1267 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:39:27.530678 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f9e06dc2-4350-43d4-94c2-4b872ae216d1 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:27.531753 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-f9e06dc2-4350-43d4-94c2-4b872ae216d1 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: c07ab9eb-c1e1-4751-be52-6af1da8790e5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:27.534436 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:39:27.539205 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f9e06dc2-4350-43d4-94c2-4b872ae216d1 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:27.539686 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f9e06dc2-4350-43d4-94c2-4b872ae216d1 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:27.540151 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f9e06dc2-4350-43d4-94c2-4b872ae216d1 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:27.540846 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f9e06dc2-4350-43d4-94c2-4b872ae216d1 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:27.541295 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f9e06dc2-4350-43d4-94c2-4b872ae216d1 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:27.541718 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f9e06dc2-4350-43d4-94c2-4b872ae216d1 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:27.556742 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:39:27.677758 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-f9e06dc2-4350-43d4-94c2-4b872ae216d1 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:27.685100 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-f9e06dc2-4350-43d4-94c2-4b872ae216d1 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/c07ab9eb-c1e1-4751-be52-6af1da8790e5" status: 200 len: 1267 microversion: 2.1 time: 0.158684 Aug 10 11:39:27.685742 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 370/738] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:39:27 2022] GET /compute/v2.1/servers/c07ab9eb-c1e1-4751-be52-6af1da8790e5 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:39:28.706694 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-034871a1-ae9c-43b6-a783-2cd007c891c0 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:28.707306 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-034871a1-ae9c-43b6-a783-2cd007c891c0 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: c07ab9eb-c1e1-4751-be52-6af1da8790e5] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:28.713836 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-034871a1-ae9c-43b6-a783-2cd007c891c0 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:28.714602 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-034871a1-ae9c-43b6-a783-2cd007c891c0 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:28.715035 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-034871a1-ae9c-43b6-a783-2cd007c891c0 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:28.716782 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-034871a1-ae9c-43b6-a783-2cd007c891c0 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:28.717326 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-034871a1-ae9c-43b6-a783-2cd007c891c0 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:28.717754 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-034871a1-ae9c-43b6-a783-2cd007c891c0 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:28.877802 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-034871a1-ae9c-43b6-a783-2cd007c891c0 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:28.881417 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:39:28.885646 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-034871a1-ae9c-43b6-a783-2cd007c891c0 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/c07ab9eb-c1e1-4751-be52-6af1da8790e5" status: 200 len: 1267 microversion: 2.1 time: 0.183718 Aug 10 11:39:28.886209 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 369/739] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:39:28 2022] GET /compute/v2.1/servers/c07ab9eb-c1e1-4751-be52-6af1da8790e5 => generated 1267 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:39:29.907998 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-9e48d9be-a27b-4720-ae44-1b69ab89ded0 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:29.908862 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-9e48d9be-a27b-4720-ae44-1b69ab89ded0 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: c07ab9eb-c1e1-4751-be52-6af1da8790e5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:29.918353 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9e48d9be-a27b-4720-ae44-1b69ab89ded0 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:29.919453 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9e48d9be-a27b-4720-ae44-1b69ab89ded0 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:29.919927 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9e48d9be-a27b-4720-ae44-1b69ab89ded0 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:29.920651 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9e48d9be-a27b-4720-ae44-1b69ab89ded0 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:29.921112 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9e48d9be-a27b-4720-ae44-1b69ab89ded0 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:29.921587 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9e48d9be-a27b-4720-ae44-1b69ab89ded0 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:30.073513 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-9e48d9be-a27b-4720-ae44-1b69ab89ded0 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:30.082089 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-9e48d9be-a27b-4720-ae44-1b69ab89ded0 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/c07ab9eb-c1e1-4751-be52-6af1da8790e5" status: 200 len: 1267 microversion: 2.1 time: 0.179100 Aug 10 11:39:30.082856 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 371/740] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:39:29 2022] GET /compute/v2.1/servers/c07ab9eb-c1e1-4751-be52-6af1da8790e5 => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:39:30.380789 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-5dcd667f-87a2-46c1-a11c-0d701806fbec req-d753c353-7dd5-407a-aa39-cdb60492582d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c07ab9eb-c1e1-4751-be52-6af1da8790e5", "name": "network-vif-plugged", "status": "completed", "tag": "49f146b4-6b29-4027-95c8-23b108907bed"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:39:30.393667 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-5dcd667f-87a2-46c1-a11c-0d701806fbec req-d753c353-7dd5-407a-aa39-cdb60492582d service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:30.394355 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-5dcd667f-87a2-46c1-a11c-0d701806fbec req-d753c353-7dd5-407a-aa39-cdb60492582d service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:30.394795 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-5dcd667f-87a2-46c1-a11c-0d701806fbec req-d753c353-7dd5-407a-aa39-cdb60492582d service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:30.417218 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-5dcd667f-87a2-46c1-a11c-0d701806fbec req-d753c353-7dd5-407a-aa39-cdb60492582d service nova] Creating event network-vif-plugged:49f146b4-6b29-4027-95c8-23b108907bed for instance c07ab9eb-c1e1-4751-be52-6af1da8790e5 on hv-cinder-85272 Aug 10 11:39:30.422886 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-5dcd667f-87a2-46c1-a11c-0d701806fbec req-d753c353-7dd5-407a-aa39-cdb60492582d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045261 Aug 10 11:39:30.423826 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 370/741] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:39:31.102926 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-4ee918fa-be77-47a6-8a70-835668a00d69 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:31.103538 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-4ee918fa-be77-47a6-8a70-835668a00d69 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: c07ab9eb-c1e1-4751-be52-6af1da8790e5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:31.112111 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4ee918fa-be77-47a6-8a70-835668a00d69 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:31.112509 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4ee918fa-be77-47a6-8a70-835668a00d69 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:31.112926 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4ee918fa-be77-47a6-8a70-835668a00d69 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:31.113627 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4ee918fa-be77-47a6-8a70-835668a00d69 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:31.114083 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4ee918fa-be77-47a6-8a70-835668a00d69 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:31.114505 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4ee918fa-be77-47a6-8a70-835668a00d69 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:31.264508 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-4ee918fa-be77-47a6-8a70-835668a00d69 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:31.274280 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-4ee918fa-be77-47a6-8a70-835668a00d69 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/c07ab9eb-c1e1-4751-be52-6af1da8790e5" status: 200 len: 1267 microversion: 2.1 time: 0.175194 Aug 10 11:39:31.274867 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 372/742] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:39:31 2022] GET /compute/v2.1/servers/c07ab9eb-c1e1-4751-be52-6af1da8790e5 => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:39:32.300309 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-12f3bfc1-9a5c-4634-a4cd-f4ee85489090 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:32.307002 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-12f3bfc1-9a5c-4634-a4cd-f4ee85489090 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: c07ab9eb-c1e1-4751-be52-6af1da8790e5] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:32.325885 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-12f3bfc1-9a5c-4634-a4cd-f4ee85489090 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:32.326653 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-12f3bfc1-9a5c-4634-a4cd-f4ee85489090 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:32.327247 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-12f3bfc1-9a5c-4634-a4cd-f4ee85489090 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:32.328163 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-12f3bfc1-9a5c-4634-a4cd-f4ee85489090 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:32.329620 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-12f3bfc1-9a5c-4634-a4cd-f4ee85489090 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:32.330302 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-12f3bfc1-9a5c-4634-a4cd-f4ee85489090 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:32.590139 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-12f3bfc1-9a5c-4634-a4cd-f4ee85489090 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:32.606389 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-12f3bfc1-9a5c-4634-a4cd-f4ee85489090 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/c07ab9eb-c1e1-4751-be52-6af1da8790e5" status: 200 len: 1267 microversion: 2.1 time: 0.315258 Aug 10 11:39:32.607489 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 371/743] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:39:32 2022] GET /compute/v2.1/servers/c07ab9eb-c1e1-4751-be52-6af1da8790e5 => generated 1267 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:39:33.629126 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-a42e99d0-15ae-40af-81f2-034575f8c4ea tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:33.629736 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-a42e99d0-15ae-40af-81f2-034575f8c4ea tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: c07ab9eb-c1e1-4751-be52-6af1da8790e5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:33.636813 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a42e99d0-15ae-40af-81f2-034575f8c4ea tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:33.637690 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a42e99d0-15ae-40af-81f2-034575f8c4ea tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:33.638348 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a42e99d0-15ae-40af-81f2-034575f8c4ea tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:33.639287 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a42e99d0-15ae-40af-81f2-034575f8c4ea tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:33.639942 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a42e99d0-15ae-40af-81f2-034575f8c4ea tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:33.641423 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a42e99d0-15ae-40af-81f2-034575f8c4ea tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:33.817773 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-a42e99d0-15ae-40af-81f2-034575f8c4ea tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:33.825906 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-a42e99d0-15ae-40af-81f2-034575f8c4ea tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/c07ab9eb-c1e1-4751-be52-6af1da8790e5" status: 200 len: 1454 microversion: 2.1 time: 0.201585 Aug 10 11:39:33.826497 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 373/744] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:39:33 2022] GET /compute/v2.1/servers/c07ab9eb-c1e1-4751-be52-6af1da8790e5 => generated 1454 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:39:33.857161 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-ffa6b7c7-ad0b-45f2-9c2f-257376dca53d tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:33.859188 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-ffa6b7c7-ad0b-45f2-9c2f-257376dca53d tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: c07ab9eb-c1e1-4751-be52-6af1da8790e5] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:33.868845 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ffa6b7c7-ad0b-45f2-9c2f-257376dca53d tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:33.870668 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ffa6b7c7-ad0b-45f2-9c2f-257376dca53d tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:33.871301 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ffa6b7c7-ad0b-45f2-9c2f-257376dca53d tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:33.872862 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ffa6b7c7-ad0b-45f2-9c2f-257376dca53d tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:33.873521 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ffa6b7c7-ad0b-45f2-9c2f-257376dca53d tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:33.874570 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ffa6b7c7-ad0b-45f2-9c2f-257376dca53d tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:34.202206 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-91041f8f-b26b-43d5-b1df-4e732a190194 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Action: 'create', calling method: .version_select at 0x7fb7cdc0c700>, body: {"keypair": {"name": "tempest-keypair-774838405", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5c7xJTzNkk58kJ9C3wk3BsutKzFzZRV94OQwUSEc+ZeyKQl9Emam1S31MgqwrlNKsnfKiaQJp2Edvuqig7QoWQJ6g1LITAgRjBI9DtdLXzi4+TCsOp9hCMOtqyxiYLUA=="}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:39:34.229709 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-91041f8f-b26b-43d5-b1df-4e732a190194 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Getting quotas for project 1275e554301b4d019da34186581fc0da. Resources: {'key_pairs'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:39:34.233831 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-91041f8f-b26b-43d5-b1df-4e732a190194 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Getting quotas for user 4f61f9a578834243b0d11888c397deff and project 1275e554301b4d019da34186581fc0da. Resources: {'key_pairs'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:39:34.303424 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-ffa6b7c7-ad0b-45f2-9c2f-257376dca53d tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:34.313781 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-91041f8f-b26b-43d5-b1df-4e732a190194 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.267661 Aug 10 11:39:34.314446 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 374/745] 10.222.0.62 () {60 vars in 1159 bytes} [Wed Aug 10 11:39:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:39:34.316055 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-ffa6b7c7-ad0b-45f2-9c2f-257376dca53d tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/c07ab9eb-c1e1-4751-be52-6af1da8790e5" status: 200 len: 1454 microversion: 2.1 time: 0.467720 Aug 10 11:39:34.316887 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 372/746] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:39:33 2022] GET /compute/v2.1/servers/c07ab9eb-c1e1-4751-be52-6af1da8790e5 => generated 1454 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:39:36.421769 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-1db9bf3c-ee3e-4df2-bce4-7449e5465044 req-be921dcb-af21-41de-a5f9-66557874ee86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c07ab9eb-c1e1-4751-be52-6af1da8790e5", "tag": "49f146b4-6b29-4027-95c8-23b108907bed"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:39:36.439593 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-1db9bf3c-ee3e-4df2-bce4-7449e5465044 req-be921dcb-af21-41de-a5f9-66557874ee86 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:36.442170 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-1db9bf3c-ee3e-4df2-bce4-7449e5465044 req-be921dcb-af21-41de-a5f9-66557874ee86 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:36.442622 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-1db9bf3c-ee3e-4df2-bce4-7449e5465044 req-be921dcb-af21-41de-a5f9-66557874ee86 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:36.455832 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-1db9bf3c-ee3e-4df2-bce4-7449e5465044 req-be921dcb-af21-41de-a5f9-66557874ee86 service nova] Creating event network-changed:49f146b4-6b29-4027-95c8-23b108907bed for instance c07ab9eb-c1e1-4751-be52-6af1da8790e5 on hv-cinder-85272 Aug 10 11:39:36.460123 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-1db9bf3c-ee3e-4df2-bce4-7449e5465044 req-be921dcb-af21-41de-a5f9-66557874ee86 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041935 Aug 10 11:39:36.461441 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 375/747] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:39:36.752687 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-d107ba5e-5668-4d5a-af46-306b37f96cd6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1209473676", "imageRef": "99bbc441-5102-4a51-a496-cfbffeb3033a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9e8c6f11-9bc0-4d49-baa5-ecd5d8e7ec5d"}], "security_groups": [{"name": "tempest-securitygroup--2073934563"}], "key_name": "tempest-keypair-774838405", "user_data": "}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:39:36.966794 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.network.neutron [None req-d107ba5e-5668-4d5a-af46-306b37f96cd6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] validate_networks() for [('9e8c6f11-9bc0-4d49-baa5-ecd5d8e7ec5d', None, None, None, None, None)] {{(pid=124682) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:39:37.525889 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-d107ba5e-5668-4d5a-af46-306b37f96cd6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Flavor limits 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:39:37.526314 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-d107ba5e-5668-4d5a-af46-306b37f96cd6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Image limits 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:39:37.526789 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-d107ba5e-5668-4d5a-af46-306b37f96cd6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Flavor pref 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:39:37.527234 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-d107ba5e-5668-4d5a-af46-306b37f96cd6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Image pref 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:39:37.527645 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-d107ba5e-5668-4d5a-af46-306b37f96cd6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:39:37.538253 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d107ba5e-5668-4d5a-af46-306b37f96cd6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:37.538756 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d107ba5e-5668-4d5a-af46-306b37f96cd6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:37.539198 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d107ba5e-5668-4d5a-af46-306b37f96cd6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:37.540017 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d107ba5e-5668-4d5a-af46-306b37f96cd6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:37.540449 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d107ba5e-5668-4d5a-af46-306b37f96cd6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:37.540924 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d107ba5e-5668-4d5a-af46-306b37f96cd6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:37.561048 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-d107ba5e-5668-4d5a-af46-306b37f96cd6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Getting quotas for project 1275e554301b4d019da34186581fc0da. Resources: {'ram', 'instances', 'cores'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:39:37.566648 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-d107ba5e-5668-4d5a-af46-306b37f96cd6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Getting quotas for user 4f61f9a578834243b0d11888c397deff and project 1275e554301b4d019da34186581fc0da. Resources: {'ram', 'instances', 'cores'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:39:37.579053 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-d107ba5e-5668-4d5a-af46-306b37f96cd6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Going to run 1 instances... {{(pid=124682) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:39:37.581402 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-d107ba5e-5668-4d5a-af46-306b37f96cd6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99bbc441-5102-4a51-a496-cfbffeb3033a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:39:37.692080 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-d107ba5e-5668-4d5a-af46-306b37f96cd6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.944618 Aug 10 11:39:37.693069 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 373/748] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Aug 10 11:39:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 946 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 11:39:37.704820 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-a513d3a2-c87f-45ae-8429-7d52260ab2c5 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:37.709031 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-a513d3a2-c87f-45ae-8429-7d52260ab2c5 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:37.769276 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-a513d3a2-c87f-45ae-8429-7d52260ab2c5 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:37.775985 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-a513d3a2-c87f-45ae-8429-7d52260ab2c5 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b" status: 200 len: 1241 microversion: 2.1 time: 0.075999 Aug 10 11:39:37.776570 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 376/749] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:39:37 2022] GET /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b => generated 1241 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:39:38.796995 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-4c5f2cf6-77f5-419e-94ad-f1eeded30b44 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:38.797531 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-4c5f2cf6-77f5-419e-94ad-f1eeded30b44 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:38.805405 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4c5f2cf6-77f5-419e-94ad-f1eeded30b44 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:38.805890 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4c5f2cf6-77f5-419e-94ad-f1eeded30b44 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:38.806380 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4c5f2cf6-77f5-419e-94ad-f1eeded30b44 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:38.807075 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4c5f2cf6-77f5-419e-94ad-f1eeded30b44 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:38.807534 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4c5f2cf6-77f5-419e-94ad-f1eeded30b44 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:38.807983 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4c5f2cf6-77f5-419e-94ad-f1eeded30b44 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:38.869837 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-4c5f2cf6-77f5-419e-94ad-f1eeded30b44 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:38.877648 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-4c5f2cf6-77f5-419e-94ad-f1eeded30b44 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b" status: 200 len: 1245 microversion: 2.1 time: 0.084708 Aug 10 11:39:38.878312 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 374/750] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:39:38 2022] GET /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:39:39.898597 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-8e6afa90-6264-4aa4-b5ea-663635bdcaab tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:39.899196 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-8e6afa90-6264-4aa4-b5ea-663635bdcaab tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:39.906457 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8e6afa90-6264-4aa4-b5ea-663635bdcaab tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:39.906945 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8e6afa90-6264-4aa4-b5ea-663635bdcaab tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:39.907381 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8e6afa90-6264-4aa4-b5ea-663635bdcaab tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:39.908113 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8e6afa90-6264-4aa4-b5ea-663635bdcaab tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:39.908570 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8e6afa90-6264-4aa4-b5ea-663635bdcaab tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:39.909004 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8e6afa90-6264-4aa4-b5ea-663635bdcaab tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:39.972439 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-8e6afa90-6264-4aa4-b5ea-663635bdcaab tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:39.980024 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-8e6afa90-6264-4aa4-b5ea-663635bdcaab tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b" status: 200 len: 1301 microversion: 2.1 time: 0.085238 Aug 10 11:39:39.984958 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 377/751] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:39:39 2022] GET /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b => generated 1301 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:39:41.002498 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-4a518186-897e-471b-b520-5119bffe4c86 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:41.003364 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-4a518186-897e-471b-b520-5119bffe4c86 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:41.010407 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4a518186-897e-471b-b520-5119bffe4c86 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:41.010892 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4a518186-897e-471b-b520-5119bffe4c86 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:41.011360 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4a518186-897e-471b-b520-5119bffe4c86 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:41.012110 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4a518186-897e-471b-b520-5119bffe4c86 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:41.012679 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4a518186-897e-471b-b520-5119bffe4c86 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:41.013164 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4a518186-897e-471b-b520-5119bffe4c86 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:41.315085 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-4a518186-897e-471b-b520-5119bffe4c86 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:41.332504 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-4a518186-897e-471b-b520-5119bffe4c86 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b" status: 200 len: 1367 microversion: 2.1 time: 0.333706 Aug 10 11:39:41.333092 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 375/752] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:39:40 2022] GET /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b => generated 1367 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:39:41.759868 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-4ea01993-7911-498d-a55c-f6883eea53db req-deb96105-f33c-40e2-99c6-21b384aa28cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b", "tag": "106fb866-bca9-40a9-b61a-90991f6179ed"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:39:41.770627 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-4ea01993-7911-498d-a55c-f6883eea53db req-deb96105-f33c-40e2-99c6-21b384aa28cf service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:41.776733 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-4ea01993-7911-498d-a55c-f6883eea53db req-deb96105-f33c-40e2-99c6-21b384aa28cf service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:41.779289 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-4ea01993-7911-498d-a55c-f6883eea53db req-deb96105-f33c-40e2-99c6-21b384aa28cf service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:41.791099 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-4ea01993-7911-498d-a55c-f6883eea53db req-deb96105-f33c-40e2-99c6-21b384aa28cf service nova] Creating event network-changed:106fb866-bca9-40a9-b61a-90991f6179ed for instance f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b on hv-cinder-85272 Aug 10 11:39:41.796171 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-4ea01993-7911-498d-a55c-f6883eea53db req-deb96105-f33c-40e2-99c6-21b384aa28cf service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040122 Aug 10 11:39:41.797429 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 378/753] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:39:42.357277 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-ef648c90-3630-4f82-808f-cfff50b2b42d tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:42.357891 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-ef648c90-3630-4f82-808f-cfff50b2b42d tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:42.375415 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ef648c90-3630-4f82-808f-cfff50b2b42d tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:42.375916 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ef648c90-3630-4f82-808f-cfff50b2b42d tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:42.377089 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ef648c90-3630-4f82-808f-cfff50b2b42d tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:42.377778 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ef648c90-3630-4f82-808f-cfff50b2b42d tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:42.378228 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ef648c90-3630-4f82-808f-cfff50b2b42d tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:42.378687 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ef648c90-3630-4f82-808f-cfff50b2b42d tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:42.566920 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-ef648c90-3630-4f82-808f-cfff50b2b42d tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:42.584593 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-ef648c90-3630-4f82-808f-cfff50b2b42d tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b" status: 200 len: 1367 microversion: 2.1 time: 0.221571 Aug 10 11:39:42.585960 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 376/754] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:39:42 2022] GET /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:39:43.606172 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-b807505c-a92a-40b4-ae0c-9eb7dacd560e tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:43.606922 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-b807505c-a92a-40b4-ae0c-9eb7dacd560e tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:43.613600 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b807505c-a92a-40b4-ae0c-9eb7dacd560e tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:43.614084 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b807505c-a92a-40b4-ae0c-9eb7dacd560e tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:43.614527 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b807505c-a92a-40b4-ae0c-9eb7dacd560e tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:43.615218 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b807505c-a92a-40b4-ae0c-9eb7dacd560e tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:43.615676 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b807505c-a92a-40b4-ae0c-9eb7dacd560e tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:43.616136 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b807505c-a92a-40b4-ae0c-9eb7dacd560e tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:43.749474 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-b807505c-a92a-40b4-ae0c-9eb7dacd560e tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:43.758036 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-b807505c-a92a-40b4-ae0c-9eb7dacd560e tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b" status: 200 len: 1367 microversion: 2.1 time: 0.156559 Aug 10 11:39:43.758596 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 379/755] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:39:43 2022] GET /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:39:44.778544 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-91efe27b-14f6-4d84-a9c5-f4da8762d50d tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:44.779199 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-91efe27b-14f6-4d84-a9c5-f4da8762d50d tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:44.786836 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-91efe27b-14f6-4d84-a9c5-f4da8762d50d tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:44.787331 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-91efe27b-14f6-4d84-a9c5-f4da8762d50d tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:44.787775 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-91efe27b-14f6-4d84-a9c5-f4da8762d50d tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:44.788512 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-91efe27b-14f6-4d84-a9c5-f4da8762d50d tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:44.788973 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-91efe27b-14f6-4d84-a9c5-f4da8762d50d tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:44.789401 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-91efe27b-14f6-4d84-a9c5-f4da8762d50d tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:44.928980 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-91efe27b-14f6-4d84-a9c5-f4da8762d50d tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:44.936506 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-91efe27b-14f6-4d84-a9c5-f4da8762d50d tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b" status: 200 len: 1367 microversion: 2.1 time: 0.161725 Aug 10 11:39:44.937069 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 377/756] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:39:44 2022] GET /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:39:45.957178 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-43e4f022-8cad-4769-8a1e-d62dabeca147 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:45.957786 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-43e4f022-8cad-4769-8a1e-d62dabeca147 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:45.964723 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-43e4f022-8cad-4769-8a1e-d62dabeca147 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:45.965206 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-43e4f022-8cad-4769-8a1e-d62dabeca147 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:45.965637 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-43e4f022-8cad-4769-8a1e-d62dabeca147 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:45.966315 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-43e4f022-8cad-4769-8a1e-d62dabeca147 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:45.966763 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-43e4f022-8cad-4769-8a1e-d62dabeca147 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:45.967182 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-43e4f022-8cad-4769-8a1e-d62dabeca147 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:46.100201 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-43e4f022-8cad-4769-8a1e-d62dabeca147 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:46.107533 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-43e4f022-8cad-4769-8a1e-d62dabeca147 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b" status: 200 len: 1367 microversion: 2.1 time: 0.154343 Aug 10 11:39:46.108120 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 380/757] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:39:45 2022] GET /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:39:47.128923 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-7b49a100-0fb4-4b7c-9855-df8e2f6eff49 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:47.129541 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-7b49a100-0fb4-4b7c-9855-df8e2f6eff49 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:47.135979 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7b49a100-0fb4-4b7c-9855-df8e2f6eff49 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:47.136472 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7b49a100-0fb4-4b7c-9855-df8e2f6eff49 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:47.136908 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7b49a100-0fb4-4b7c-9855-df8e2f6eff49 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:47.137601 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7b49a100-0fb4-4b7c-9855-df8e2f6eff49 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:47.138054 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7b49a100-0fb4-4b7c-9855-df8e2f6eff49 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:47.138481 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7b49a100-0fb4-4b7c-9855-df8e2f6eff49 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:47.267327 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-7b49a100-0fb4-4b7c-9855-df8e2f6eff49 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:47.274832 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-7b49a100-0fb4-4b7c-9855-df8e2f6eff49 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b" status: 200 len: 1367 microversion: 2.1 time: 0.150249 Aug 10 11:39:47.275391 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 378/758] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:39:47 2022] GET /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:39:48.296058 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-317d4216-52c2-4d93-a076-6dee1f37a6be tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:48.296672 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-317d4216-52c2-4d93-a076-6dee1f37a6be tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:48.299649 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=6 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:39:48.304502 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-317d4216-52c2-4d93-a076-6dee1f37a6be tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:48.305048 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-317d4216-52c2-4d93-a076-6dee1f37a6be tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:48.305479 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-317d4216-52c2-4d93-a076-6dee1f37a6be tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:48.306172 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-317d4216-52c2-4d93-a076-6dee1f37a6be tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:48.306671 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-317d4216-52c2-4d93-a076-6dee1f37a6be tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:48.307094 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-317d4216-52c2-4d93-a076-6dee1f37a6be tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:48.310110 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-3b3ade0e-8e77-409c-aebe-f53982abb44e req-74784e2e-d5cc-41a6-bfa0-4db7c511b4ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b", "name": "network-vif-plugged", "status": "completed", "tag": "106fb866-bca9-40a9-b61a-90991f6179ed"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:39:48.317817 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=2 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:39:48.318625 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=6 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:39:48.322972 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-3b3ade0e-8e77-409c-aebe-f53982abb44e req-74784e2e-d5cc-41a6-bfa0-4db7c511b4ef service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:48.323453 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-3b3ade0e-8e77-409c-aebe-f53982abb44e req-74784e2e-d5cc-41a6-bfa0-4db7c511b4ef service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:48.323886 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-3b3ade0e-8e77-409c-aebe-f53982abb44e req-74784e2e-d5cc-41a6-bfa0-4db7c511b4ef service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:48.335952 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-3b3ade0e-8e77-409c-aebe-f53982abb44e req-74784e2e-d5cc-41a6-bfa0-4db7c511b4ef service nova] Creating event network-vif-plugged:106fb866-bca9-40a9-b61a-90991f6179ed for instance f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b on hv-cinder-85272 Aug 10 11:39:48.341107 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-3b3ade0e-8e77-409c-aebe-f53982abb44e req-74784e2e-d5cc-41a6-bfa0-4db7c511b4ef service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034814 Aug 10 11:39:48.341700 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 379/759] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:39:48.442873 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-317d4216-52c2-4d93-a076-6dee1f37a6be tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:48.450584 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-317d4216-52c2-4d93-a076-6dee1f37a6be tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b" status: 200 len: 1367 microversion: 2.1 time: 0.158439 Aug 10 11:39:48.451155 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 381/760] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:39:48 2022] GET /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:39:49.472464 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-33470472-3312-41c3-91c5-2c0fe06fa776 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:49.473161 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-33470472-3312-41c3-91c5-2c0fe06fa776 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:49.480337 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-33470472-3312-41c3-91c5-2c0fe06fa776 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:49.480822 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-33470472-3312-41c3-91c5-2c0fe06fa776 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:49.481254 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-33470472-3312-41c3-91c5-2c0fe06fa776 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:49.481930 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-33470472-3312-41c3-91c5-2c0fe06fa776 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:49.482378 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-33470472-3312-41c3-91c5-2c0fe06fa776 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:49.482797 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-33470472-3312-41c3-91c5-2c0fe06fa776 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:49.615420 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-33470472-3312-41c3-91c5-2c0fe06fa776 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:49.622754 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-33470472-3312-41c3-91c5-2c0fe06fa776 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b" status: 200 len: 1367 microversion: 2.1 time: 0.155890 Aug 10 11:39:49.623312 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 380/761] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:39:49 2022] GET /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:39:50.655565 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-48e81ca6-3fd1-4448-ba9d-2174f3a9ccf7 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:50.656211 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-48e81ca6-3fd1-4448-ba9d-2174f3a9ccf7 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:50.658922 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-95bd5db0-52a5-42eb-a620-05a9235382ef tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:50.661103 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-95bd5db0-52a5-42eb-a620-05a9235382ef tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:50.663356 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-48e81ca6-3fd1-4448-ba9d-2174f3a9ccf7 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:50.663847 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-48e81ca6-3fd1-4448-ba9d-2174f3a9ccf7 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:50.664927 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-48e81ca6-3fd1-4448-ba9d-2174f3a9ccf7 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:50.665941 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-48e81ca6-3fd1-4448-ba9d-2174f3a9ccf7 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:50.666647 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-48e81ca6-3fd1-4448-ba9d-2174f3a9ccf7 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:50.667456 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-48e81ca6-3fd1-4448-ba9d-2174f3a9ccf7 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:50.669574 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-95bd5db0-52a5-42eb-a620-05a9235382ef tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:50.670068 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-95bd5db0-52a5-42eb-a620-05a9235382ef tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:50.670698 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-95bd5db0-52a5-42eb-a620-05a9235382ef tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:50.671621 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-95bd5db0-52a5-42eb-a620-05a9235382ef tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:50.672048 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-95bd5db0-52a5-42eb-a620-05a9235382ef tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:50.673265 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-95bd5db0-52a5-42eb-a620-05a9235382ef tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:50.703211 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-95bd5db0-52a5-42eb-a620-05a9235382ef tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049480 Aug 10 11:39:50.703995 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 381/762] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 10 11:39:50 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:39:50.768416 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-e6ef46ab-c8c6-4956-88a5-595eb05a0d1e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:50.769754 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-e6ef46ab-c8c6-4956-88a5-595eb05a0d1e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:50.775946 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e6ef46ab-c8c6-4956-88a5-595eb05a0d1e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:50.776458 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e6ef46ab-c8c6-4956-88a5-595eb05a0d1e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:50.776887 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e6ef46ab-c8c6-4956-88a5-595eb05a0d1e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:50.777792 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e6ef46ab-c8c6-4956-88a5-595eb05a0d1e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:50.778253 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e6ef46ab-c8c6-4956-88a5-595eb05a0d1e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:50.778671 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e6ef46ab-c8c6-4956-88a5-595eb05a0d1e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:50.804817 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-e6ef46ab-c8c6-4956-88a5-595eb05a0d1e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Going to try to terminate instance {{(pid=124682) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:39:50.816084 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-48e81ca6-3fd1-4448-ba9d-2174f3a9ccf7 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:50.824071 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-48e81ca6-3fd1-4448-ba9d-2174f3a9ccf7 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b" status: 200 len: 1557 microversion: 2.1 time: 0.172255 Aug 10 11:39:50.824711 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 382/763] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:39:50 2022] GET /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b => generated 1557 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:39:50.845716 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-7f7b8543-b34b-41f0-9121-4780e1084720 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:50.846238 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-7f7b8543-b34b-41f0-9121-4780e1084720 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:50.852173 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7f7b8543-b34b-41f0-9121-4780e1084720 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:50.855821 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7f7b8543-b34b-41f0-9121-4780e1084720 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:50.855821 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7f7b8543-b34b-41f0-9121-4780e1084720 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:50.855821 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7f7b8543-b34b-41f0-9121-4780e1084720 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:50.855821 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7f7b8543-b34b-41f0-9121-4780e1084720 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:50.856245 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7f7b8543-b34b-41f0-9121-4780e1084720 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:50.931696 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-7f7b8543-b34b-41f0-9121-4780e1084720 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090582 Aug 10 11:39:50.932440 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 383/764] 10.222.0.62 () {58 vars in 1275 bytes} [Wed Aug 10 11:39:50 2022] GET /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:39:51.106547 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-e6ef46ab-c8c6-4956-88a5-595eb05a0d1e tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "DELETE /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 204 len: 0 microversion: 2.20 time: 0.342003 Aug 10 11:39:51.107185 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 382/765] 10.222.0.62 () {60 vars in 1280 bytes} [Wed Aug 10 11:39:50 2022] DELETE /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 10 11:39:51.116070 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-d77cf4a3-5e03-44a1-884c-2078efd408ec tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:51.116704 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-d77cf4a3-5e03-44a1-884c-2078efd408ec tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:51.122826 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d77cf4a3-5e03-44a1-884c-2078efd408ec tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:51.123309 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d77cf4a3-5e03-44a1-884c-2078efd408ec tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:51.126366 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d77cf4a3-5e03-44a1-884c-2078efd408ec tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:51.126366 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d77cf4a3-5e03-44a1-884c-2078efd408ec tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:51.126366 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d77cf4a3-5e03-44a1-884c-2078efd408ec tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:51.126366 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d77cf4a3-5e03-44a1-884c-2078efd408ec tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:51.256037 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-d77cf4a3-5e03-44a1-884c-2078efd408ec tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:51.263974 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-d77cf4a3-5e03-44a1-884c-2078efd408ec tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:51.265720 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-d77cf4a3-5e03-44a1-884c-2078efd408ec tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:51.267401 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-d77cf4a3-5e03-44a1-884c-2078efd408ec tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1723 microversion: 2.20 time: 0.155384 Aug 10 11:39:51.267991 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 384/766] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:39:51 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:39:51.947783 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-47cf3886-127b-496c-880a-a4d9ee6ca6c6 req-cc258f91-4af3-4e75-aa45-3434ad004da5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b", "tag": "106fb866-bca9-40a9-b61a-90991f6179ed"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:39:51.953660 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:39:51.958878 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-47cf3886-127b-496c-880a-a4d9ee6ca6c6 req-cc258f91-4af3-4e75-aa45-3434ad004da5 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:51.959392 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-47cf3886-127b-496c-880a-a4d9ee6ca6c6 req-cc258f91-4af3-4e75-aa45-3434ad004da5 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:51.959825 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-47cf3886-127b-496c-880a-a4d9ee6ca6c6 req-cc258f91-4af3-4e75-aa45-3434ad004da5 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:51.971630 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-47cf3886-127b-496c-880a-a4d9ee6ca6c6 req-cc258f91-4af3-4e75-aa45-3434ad004da5 service nova] Creating event network-changed:106fb866-bca9-40a9-b61a-90991f6179ed for instance f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b on hv-cinder-85272 Aug 10 11:39:51.976608 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-47cf3886-127b-496c-880a-a4d9ee6ca6c6 req-cc258f91-4af3-4e75-aa45-3434ad004da5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032752 Aug 10 11:39:51.977201 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 383/767] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:39:52.290338 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-965e080d-4d6a-470d-97ed-282a1468ba93 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:52.290955 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-965e080d-4d6a-470d-97ed-282a1468ba93 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:52.297326 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-965e080d-4d6a-470d-97ed-282a1468ba93 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:52.298451 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-965e080d-4d6a-470d-97ed-282a1468ba93 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:52.298891 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-965e080d-4d6a-470d-97ed-282a1468ba93 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:52.299591 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-965e080d-4d6a-470d-97ed-282a1468ba93 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:52.300078 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-965e080d-4d6a-470d-97ed-282a1468ba93 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:52.301091 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-965e080d-4d6a-470d-97ed-282a1468ba93 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:52.445533 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-965e080d-4d6a-470d-97ed-282a1468ba93 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:52.454342 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-965e080d-4d6a-470d-97ed-282a1468ba93 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:52.455678 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-965e080d-4d6a-470d-97ed-282a1468ba93 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:52.456901 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-965e080d-4d6a-470d-97ed-282a1468ba93 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1723 microversion: 2.20 time: 0.170464 Aug 10 11:39:52.457831 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 385/768] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:39:52 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:39:53.482012 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-d2909af3-7b58-466e-a9dd-f1ad9e1ddaa6 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:53.482723 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-d2909af3-7b58-466e-a9dd-f1ad9e1ddaa6 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:53.489492 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d2909af3-7b58-466e-a9dd-f1ad9e1ddaa6 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:53.490125 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d2909af3-7b58-466e-a9dd-f1ad9e1ddaa6 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:53.498022 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d2909af3-7b58-466e-a9dd-f1ad9e1ddaa6 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:53.498022 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d2909af3-7b58-466e-a9dd-f1ad9e1ddaa6 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:53.498022 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d2909af3-7b58-466e-a9dd-f1ad9e1ddaa6 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:53.498022 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d2909af3-7b58-466e-a9dd-f1ad9e1ddaa6 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:53.557521 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-d2909af3-7b58-466e-a9dd-f1ad9e1ddaa6 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:53.565849 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-d2909af3-7b58-466e-a9dd-f1ad9e1ddaa6 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:53.567406 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-d2909af3-7b58-466e-a9dd-f1ad9e1ddaa6 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:53.568604 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-d2909af3-7b58-466e-a9dd-f1ad9e1ddaa6 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1656 microversion: 2.20 time: 0.091764 Aug 10 11:39:53.569132 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 384/769] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:39:53 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1656 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:39:53.974565 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-86439210-38ad-4ed3-926e-991da8c0d99f req-b8f5688d-0cd9-4a62-91fe-8432d2a0a6ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "865edaf1-a2d9-492e-af4c-05e5aecd6cf8", "name": "network-vif-deleted", "tag": "61acbadb-ed19-49d1-a43f-0e58327b568a"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:39:53.983937 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-86439210-38ad-4ed3-926e-991da8c0d99f req-b8f5688d-0cd9-4a62-91fe-8432d2a0a6ac service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:53.984367 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-86439210-38ad-4ed3-926e-991da8c0d99f req-b8f5688d-0cd9-4a62-91fe-8432d2a0a6ac service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:53.984790 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-86439210-38ad-4ed3-926e-991da8c0d99f req-b8f5688d-0cd9-4a62-91fe-8432d2a0a6ac service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:53.995875 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-86439210-38ad-4ed3-926e-991da8c0d99f req-b8f5688d-0cd9-4a62-91fe-8432d2a0a6ac service nova] Creating event network-vif-deleted:61acbadb-ed19-49d1-a43f-0e58327b568a for instance 865edaf1-a2d9-492e-af4c-05e5aecd6cf8 on hv-cinder-85272 Aug 10 11:39:54.001694 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-86439210-38ad-4ed3-926e-991da8c0d99f req-b8f5688d-0cd9-4a62-91fe-8432d2a0a6ac service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.218723 Aug 10 11:39:54.002300 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 386/770] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:39:54.592798 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-09ac9b1b-5ed1-42cf-8492-c887d867dba6 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:54.593411 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-09ac9b1b-5ed1-42cf-8492-c887d867dba6 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:54.601435 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-09ac9b1b-5ed1-42cf-8492-c887d867dba6 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:54.601924 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-09ac9b1b-5ed1-42cf-8492-c887d867dba6 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:54.607106 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-09ac9b1b-5ed1-42cf-8492-c887d867dba6 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:54.607106 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-09ac9b1b-5ed1-42cf-8492-c887d867dba6 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:54.607106 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-09ac9b1b-5ed1-42cf-8492-c887d867dba6 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:54.607106 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-09ac9b1b-5ed1-42cf-8492-c887d867dba6 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:54.643166 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-09ac9b1b-5ed1-42cf-8492-c887d867dba6 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:54.643648 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-09ac9b1b-5ed1-42cf-8492-c887d867dba6 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:54.644325 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-09ac9b1b-5ed1-42cf-8492-c887d867dba6 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:54.644771 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.objects.instance [None req-09ac9b1b-5ed1-42cf-8492-c887d867dba6 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lazy-loading 'fault' on Instance uuid 865edaf1-a2d9-492e-af4c-05e5aecd6cf8 {{(pid=124682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:39:54.690705 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-09ac9b1b-5ed1-42cf-8492-c887d867dba6 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:54.699039 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-09ac9b1b-5ed1-42cf-8492-c887d867dba6 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:54.700571 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-09ac9b1b-5ed1-42cf-8492-c887d867dba6 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84c1f36162fa4537923cd19f21bbd20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3366c89fa049939147e3761e0c8d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:39:54.701719 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-09ac9b1b-5ed1-42cf-8492-c887d867dba6 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 200 len: 1371 microversion: 2.20 time: 0.112977 Aug 10 11:39:54.702260 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 385/771] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:39:54 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 1371 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:39:55.725876 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-34e3e181-d7eb-45ef-8604-7d796ab1c851 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:55.726576 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-34e3e181-d7eb-45ef-8604-7d796ab1c851 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:55.732704 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-34e3e181-d7eb-45ef-8604-7d796ab1c851 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:55.733183 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-34e3e181-d7eb-45ef-8604-7d796ab1c851 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:55.733625 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-34e3e181-d7eb-45ef-8604-7d796ab1c851 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:55.734310 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-34e3e181-d7eb-45ef-8604-7d796ab1c851 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:55.734762 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-34e3e181-d7eb-45ef-8604-7d796ab1c851 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:55.735207 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-34e3e181-d7eb-45ef-8604-7d796ab1c851 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:55.748314 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-34e3e181-d7eb-45ef-8604-7d796ab1c851 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] HTTP exception thrown: Instance 865edaf1-a2d9-492e-af4c-05e5aecd6cf8 could not be found. Aug 10 11:39:55.749943 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-34e3e181-d7eb-45ef-8604-7d796ab1c851 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Request method failure captured: Aug 10 11:39:55.749943 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: request: GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 HTTP/1.1 Aug 10 11:39:55.749943 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept: application/json Aug 10 11:39:55.749943 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Aug 10 11:39:55.749943 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Connection: close Aug 10 11:39:55.749943 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Length: 0 Aug 10 11:39:55.749943 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Type: application/json Aug 10 11:39:55.749943 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Host: 10.222.0.62 Aug 10 11:39:55.749943 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Aug 10 11:39:55.749943 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.11 Aug 10 11:39:55.749943 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABi85dbPpkD1lR6RgeGxs20S9zIpw9_vWmHYwF3S3efUNWpa3XkvYBD_qP6zOAi-1YEMOe9G-Nqxrr80D-z8SZs034-HRTFI0Jc1vEbrcFlCMHBEnhSQC8MmaTwEs8VeOUyk0d7je2_5L6HblSoU8Ec68jOZAZkEjpVrGpZ3jFH507P8oA Aug 10 11:39:55.749943 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Aug 10 11:39:55.749943 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Aug 10 11:39:55.749943 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Aug 10 11:39:55.749943 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Aug 10 11:39:55.749943 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 11:39:55.749943 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Aug 10 11:39:55.749943 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Aug 10 11:39:55.749943 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Id: bc3366c89fa049939147e3761e0c8d1a Aug 10 11:39:55.749943 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-671694811 Aug 10 11:39:55.749943 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Role: member,reader Aug 10 11:39:55.749943 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Aug 10 11:39:55.751810 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bc3366c89fa049939147e3761e0c8d1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bc3366c89fa049939147e3761e0c8d1a", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bc3366c89fa049939147e3761e0c8d1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bc3366c89fa049939147e3761e0c8d1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:39:55.751810 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-AttachVolumeShelveTestJSON-671694811 Aug 10 11:39:55.751810 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Id: bc3366c89fa049939147e3761e0c8d1a Aug 10 11:39:55.751810 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-671694811 Aug 10 11:39:55.751810 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User: tempest-AttachVolumeShelveTestJSON-671694811-project Aug 10 11:39:55.751810 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Aug 10 11:39:55.751810 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Aug 10 11:39:55.751810 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Id: 84c1f36162fa4537923cd19f21bbd20c Aug 10 11:39:55.751810 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-AttachVolumeShelveTestJSON-671694811-project Aug 10 11:39:55.751810 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: method: > Aug 10 11:39:55.751810 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: exception: Instance 865edaf1-a2d9-492e-af4c-05e5aecd6cf8 could not be found. Aug 10 11:39:55.751810 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: action_args: {'id': '865edaf1-a2d9-492e-af4c-05e5aecd6cf8'} Aug 10 11:39:55.752847 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:39:55.752847 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:39:55.752847 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:39:55.752847 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:39:55.752847 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:39:55.752847 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:39:55.752847 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:39:55.752847 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:39:55.752847 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:39:55.752847 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:39:55.752847 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 865edaf1-a2d9-492e-af4c-05e5aecd6cf8 could not be found. Aug 10 11:39:55.752847 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:39:55.752847 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:39:55.752847 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:39:55.752847 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:39:55.752847 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:39:55.752847 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:39:55.752847 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:39:55.752847 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:39:55.752847 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:39:55.754468 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:39:55.754468 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:39:55.754468 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:39:55.754468 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:39:55.754468 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:39:55.754468 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:39:55.754468 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:39:55.754468 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 865edaf1-a2d9-492e-af4c-05e5aecd6cf8 could not be found. Aug 10 11:39:55.754468 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:39:55.754468 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:39:55.754468 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:39:55.754468 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:39:55.754468 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:39:55.754468 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:39:55.754468 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:39:55.754468 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:39:55.754468 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 865edaf1-a2d9-492e-af4c-05e5aecd6cf8 could not be found. Aug 10 11:39:55.754468 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:39:55.755872 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-34e3e181-d7eb-45ef-8604-7d796ab1c851 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Returning 404 to user: Instance 865edaf1-a2d9-492e-af4c-05e5aecd6cf8 could not be found. {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:39:55.755872 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-34e3e181-d7eb-45ef-8604-7d796ab1c851 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 404 len: 111 microversion: 2.20 time: 0.030727 Aug 10 11:39:55.755872 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 387/772] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:39:55 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 11:39:55.760150 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-55a59e9c-9ef0-42c7-9696-a1a817d8d8dc tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '.version_select at 0x7fb7cdc47dc0>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:55.843187 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-55a59e9c-9ef0-42c7-9696-a1a817d8d8dc tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-495525057" status: 204 len: 0 microversion: 2.20 time: 0.086762 Aug 10 11:39:55.843773 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 386/773] 10.222.0.62 () {60 vars in 1259 bytes} [Wed Aug 10 11:39:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-495525057 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 11:39:57.842293 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-ee6fac2f-31f7-43b1-aed1-86767b326477 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:57.842788 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-ee6fac2f-31f7-43b1-aed1-86767b326477 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:57.849794 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ee6fac2f-31f7-43b1-aed1-86767b326477 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:57.850263 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ee6fac2f-31f7-43b1-aed1-86767b326477 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:57.850690 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ee6fac2f-31f7-43b1-aed1-86767b326477 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:57.851369 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ee6fac2f-31f7-43b1-aed1-86767b326477 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:57.851814 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ee6fac2f-31f7-43b1-aed1-86767b326477 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:57.852269 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ee6fac2f-31f7-43b1-aed1-86767b326477 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:57.865299 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-ee6fac2f-31f7-43b1-aed1-86767b326477 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] HTTP exception thrown: Instance 865edaf1-a2d9-492e-af4c-05e5aecd6cf8 could not be found. Aug 10 11:39:57.866830 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-ee6fac2f-31f7-43b1-aed1-86767b326477 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Request method failure captured: Aug 10 11:39:57.866830 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: request: DELETE /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 HTTP/1.1 Aug 10 11:39:57.866830 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept: application/json Aug 10 11:39:57.866830 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Aug 10 11:39:57.866830 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Connection: close Aug 10 11:39:57.866830 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Length: 0 Aug 10 11:39:57.866830 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Type: application/json Aug 10 11:39:57.866830 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Host: 10.222.0.62 Aug 10 11:39:57.866830 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Aug 10 11:39:57.866830 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.11 Aug 10 11:39:57.866830 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABi85dbPpkD1lR6RgeGxs20S9zIpw9_vWmHYwF3S3efUNWpa3XkvYBD_qP6zOAi-1YEMOe9G-Nqxrr80D-z8SZs034-HRTFI0Jc1vEbrcFlCMHBEnhSQC8MmaTwEs8VeOUyk0d7je2_5L6HblSoU8Ec68jOZAZkEjpVrGpZ3jFH507P8oA Aug 10 11:39:57.866830 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Aug 10 11:39:57.866830 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Aug 10 11:39:57.866830 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Aug 10 11:39:57.866830 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Aug 10 11:39:57.866830 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 11:39:57.866830 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Aug 10 11:39:57.866830 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Aug 10 11:39:57.866830 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Id: bc3366c89fa049939147e3761e0c8d1a Aug 10 11:39:57.866830 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-671694811 Aug 10 11:39:57.866830 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Role: member,reader Aug 10 11:39:57.866830 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Aug 10 11:39:57.868492 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bc3366c89fa049939147e3761e0c8d1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bc3366c89fa049939147e3761e0c8d1a", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bc3366c89fa049939147e3761e0c8d1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bc3366c89fa049939147e3761e0c8d1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:39:57.868492 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-AttachVolumeShelveTestJSON-671694811 Aug 10 11:39:57.868492 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Id: bc3366c89fa049939147e3761e0c8d1a Aug 10 11:39:57.868492 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-671694811 Aug 10 11:39:57.868492 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User: tempest-AttachVolumeShelveTestJSON-671694811-project Aug 10 11:39:57.868492 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Aug 10 11:39:57.868492 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Aug 10 11:39:57.868492 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Id: 84c1f36162fa4537923cd19f21bbd20c Aug 10 11:39:57.868492 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-AttachVolumeShelveTestJSON-671694811-project Aug 10 11:39:57.868492 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: method: > Aug 10 11:39:57.868492 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: exception: Instance 865edaf1-a2d9-492e-af4c-05e5aecd6cf8 could not be found. Aug 10 11:39:57.868492 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: action_args: {'id': '865edaf1-a2d9-492e-af4c-05e5aecd6cf8'} Aug 10 11:39:57.869338 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:39:57.869338 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:39:57.869338 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:39:57.869338 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:39:57.869338 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:39:57.869338 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:39:57.869338 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:39:57.869338 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:39:57.869338 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:39:57.869338 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:39:57.869338 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 865edaf1-a2d9-492e-af4c-05e5aecd6cf8 could not be found. Aug 10 11:39:57.869338 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:39:57.869338 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:39:57.869338 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:39:57.869338 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:39:57.869338 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:39:57.869338 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:39:57.869338 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:39:57.869338 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:39:57.869338 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:39:57.870585 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:39:57.870585 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 11:39:57.870585 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 11:39:57.870585 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 11:39:57.870585 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 11:39:57.870585 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:39:57.870585 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:39:57.870585 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:39:57.870585 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:39:57.870585 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 865edaf1-a2d9-492e-af4c-05e5aecd6cf8 could not be found. Aug 10 11:39:57.870585 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:39:57.870585 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:39:57.870585 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:39:57.870585 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:39:57.870585 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:39:57.870585 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:39:57.870585 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:39:57.870585 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:39:57.870585 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 865edaf1-a2d9-492e-af4c-05e5aecd6cf8 could not be found. Aug 10 11:39:57.870585 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:39:57.872026 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-ee6fac2f-31f7-43b1-aed1-86767b326477 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Returning 404 to user: Instance 865edaf1-a2d9-492e-af4c-05e5aecd6cf8 could not be found. {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:39:57.872026 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-ee6fac2f-31f7-43b1-aed1-86767b326477 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "DELETE /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 404 len: 111 microversion: 2.20 time: 0.029684 Aug 10 11:39:57.872026 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 388/774] 10.222.0.62 () {60 vars in 1280 bytes} [Wed Aug 10 11:39:57 2022] DELETE /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 11:39:57.877436 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-1a60fe81-3469-410a-85ad-2c7a5389524c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:57.878052 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-1a60fe81-3469-410a-85ad-2c7a5389524c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 865edaf1-a2d9-492e-af4c-05e5aecd6cf8] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:57.884864 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1a60fe81-3469-410a-85ad-2c7a5389524c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:57.885346 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1a60fe81-3469-410a-85ad-2c7a5389524c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:57.885785 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1a60fe81-3469-410a-85ad-2c7a5389524c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:57.886474 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1a60fe81-3469-410a-85ad-2c7a5389524c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:57.886937 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1a60fe81-3469-410a-85ad-2c7a5389524c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:57.887367 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1a60fe81-3469-410a-85ad-2c7a5389524c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:57.901545 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.wsgi [None req-1a60fe81-3469-410a-85ad-2c7a5389524c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] HTTP exception thrown: Instance 865edaf1-a2d9-492e-af4c-05e5aecd6cf8 could not be found. Aug 10 11:39:57.903193 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-1a60fe81-3469-410a-85ad-2c7a5389524c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Request method failure captured: Aug 10 11:39:57.903193 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: request: GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 HTTP/1.1 Aug 10 11:39:57.903193 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Accept: application/json Aug 10 11:39:57.903193 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Aug 10 11:39:57.903193 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Connection: close Aug 10 11:39:57.903193 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Content-Length: 0 Aug 10 11:39:57.903193 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Content-Type: application/json Aug 10 11:39:57.903193 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Host: 10.222.0.62 Aug 10 11:39:57.903193 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Aug 10 11:39:57.903193 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.11 Aug 10 11:39:57.903193 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABi85dbPpkD1lR6RgeGxs20S9zIpw9_vWmHYwF3S3efUNWpa3XkvYBD_qP6zOAi-1YEMOe9G-Nqxrr80D-z8SZs034-HRTFI0Jc1vEbrcFlCMHBEnhSQC8MmaTwEs8VeOUyk0d7je2_5L6HblSoU8Ec68jOZAZkEjpVrGpZ3jFH507P8oA Aug 10 11:39:57.903193 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Aug 10 11:39:57.903193 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Aug 10 11:39:57.903193 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Aug 10 11:39:57.903193 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Aug 10 11:39:57.903193 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 11:39:57.903193 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Aug 10 11:39:57.903193 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Aug 10 11:39:57.903193 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Id: bc3366c89fa049939147e3761e0c8d1a Aug 10 11:39:57.903193 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-671694811 Aug 10 11:39:57.903193 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Role: member,reader Aug 10 11:39:57.903193 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Aug 10 11:39:57.904913 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bc3366c89fa049939147e3761e0c8d1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bc3366c89fa049939147e3761e0c8d1a", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bc3366c89fa049939147e3761e0c8d1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bc3366c89fa049939147e3761e0c8d1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:39:57.904913 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-AttachVolumeShelveTestJSON-671694811 Aug 10 11:39:57.904913 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant-Id: bc3366c89fa049939147e3761e0c8d1a Aug 10 11:39:57.904913 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-671694811 Aug 10 11:39:57.904913 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User: tempest-AttachVolumeShelveTestJSON-671694811-project Aug 10 11:39:57.904913 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Aug 10 11:39:57.904913 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Aug 10 11:39:57.904913 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Id: 84c1f36162fa4537923cd19f21bbd20c Aug 10 11:39:57.904913 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-AttachVolumeShelveTestJSON-671694811-project Aug 10 11:39:57.904913 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: method: > Aug 10 11:39:57.904913 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: exception: Instance 865edaf1-a2d9-492e-af4c-05e5aecd6cf8 could not be found. Aug 10 11:39:57.904913 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: action_args: {'id': '865edaf1-a2d9-492e-af4c-05e5aecd6cf8'} Aug 10 11:39:57.905814 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:39:57.905814 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:39:57.905814 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:39:57.905814 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:39:57.905814 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:39:57.905814 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:39:57.905814 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:39:57.905814 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:39:57.905814 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:39:57.905814 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:39:57.905814 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 865edaf1-a2d9-492e-af4c-05e5aecd6cf8 could not be found. Aug 10 11:39:57.905814 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:39:57.905814 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:39:57.905814 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:39:57.905814 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:39:57.905814 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:39:57.905814 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:39:57.905814 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:39:57.905814 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:39:57.905814 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:39:57.907846 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:39:57.907846 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:39:57.907846 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:39:57.907846 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:39:57.907846 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:39:57.907846 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:39:57.907846 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:39:57.907846 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 865edaf1-a2d9-492e-af4c-05e5aecd6cf8 could not be found. Aug 10 11:39:57.907846 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:39:57.907846 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:39:57.907846 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:39:57.907846 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:39:57.907846 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:39:57.907846 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:39:57.907846 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:39:57.907846 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:39:57.907846 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 865edaf1-a2d9-492e-af4c-05e5aecd6cf8 could not be found. Aug 10 11:39:57.907846 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:39:57.909192 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-1a60fe81-3469-410a-85ad-2c7a5389524c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Returning 404 to user: Instance 865edaf1-a2d9-492e-af4c-05e5aecd6cf8 could not be found. {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:39:57.909192 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-1a60fe81-3469-410a-85ad-2c7a5389524c tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8" status: 404 len: 111 microversion: 2.20 time: 0.031796 Aug 10 11:39:57.909192 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 387/775] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:39:57 2022] GET /compute/v2.1/servers/865edaf1-a2d9-492e-af4c-05e5aecd6cf8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 11:39:59.211498 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-9d44c9f4-9e03-450b-89ec-4e9a32e3f294 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:59.212010 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-9d44c9f4-9e03-450b-89ec-4e9a32e3f294 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:59.218406 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9d44c9f4-9e03-450b-89ec-4e9a32e3f294 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:59.218888 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9d44c9f4-9e03-450b-89ec-4e9a32e3f294 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:59.220120 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9d44c9f4-9e03-450b-89ec-4e9a32e3f294 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:59.220819 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9d44c9f4-9e03-450b-89ec-4e9a32e3f294 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:59.221274 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9d44c9f4-9e03-450b-89ec-4e9a32e3f294 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:59.221702 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9d44c9f4-9e03-450b-89ec-4e9a32e3f294 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:59.235484 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-9d44c9f4-9e03-450b-89ec-4e9a32e3f294 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] HTTP exception thrown: Instance 9e6ed242-956f-4b14-8520-18920447bf05 could not be found. Aug 10 11:39:59.236963 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-9d44c9f4-9e03-450b-89ec-4e9a32e3f294 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Request method failure captured: Aug 10 11:39:59.236963 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: request: DELETE /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 HTTP/1.1 Aug 10 11:39:59.236963 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept: application/json Aug 10 11:39:59.236963 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Aug 10 11:39:59.236963 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Connection: close Aug 10 11:39:59.236963 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Length: 0 Aug 10 11:39:59.236963 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Type: application/json Aug 10 11:39:59.236963 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Host: 10.222.0.62 Aug 10 11:39:59.236963 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Aug 10 11:39:59.236963 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.11 Aug 10 11:39:59.236963 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABi85dbPpkD1lR6RgeGxs20S9zIpw9_vWmHYwF3S3efUNWpa3XkvYBD_qP6zOAi-1YEMOe9G-Nqxrr80D-z8SZs034-HRTFI0Jc1vEbrcFlCMHBEnhSQC8MmaTwEs8VeOUyk0d7je2_5L6HblSoU8Ec68jOZAZkEjpVrGpZ3jFH507P8oA Aug 10 11:39:59.236963 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Aug 10 11:39:59.236963 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Aug 10 11:39:59.236963 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Aug 10 11:39:59.236963 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Aug 10 11:39:59.236963 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 11:39:59.236963 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Aug 10 11:39:59.236963 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Aug 10 11:39:59.236963 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Id: bc3366c89fa049939147e3761e0c8d1a Aug 10 11:39:59.236963 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-671694811 Aug 10 11:39:59.236963 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Role: member,reader Aug 10 11:39:59.236963 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Aug 10 11:39:59.238703 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bc3366c89fa049939147e3761e0c8d1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bc3366c89fa049939147e3761e0c8d1a", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bc3366c89fa049939147e3761e0c8d1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bc3366c89fa049939147e3761e0c8d1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:39:59.238703 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-AttachVolumeShelveTestJSON-671694811 Aug 10 11:39:59.238703 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Id: bc3366c89fa049939147e3761e0c8d1a Aug 10 11:39:59.238703 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-671694811 Aug 10 11:39:59.238703 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User: tempest-AttachVolumeShelveTestJSON-671694811-project Aug 10 11:39:59.238703 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Aug 10 11:39:59.238703 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Aug 10 11:39:59.238703 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Id: 84c1f36162fa4537923cd19f21bbd20c Aug 10 11:39:59.238703 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-AttachVolumeShelveTestJSON-671694811-project Aug 10 11:39:59.238703 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: method: > Aug 10 11:39:59.238703 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: exception: Instance 9e6ed242-956f-4b14-8520-18920447bf05 could not be found. Aug 10 11:39:59.238703 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: action_args: {'id': '9e6ed242-956f-4b14-8520-18920447bf05'} Aug 10 11:39:59.239755 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:39:59.239755 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:39:59.239755 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:39:59.239755 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:39:59.239755 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:39:59.239755 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:39:59.239755 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:39:59.239755 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:39:59.239755 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:39:59.239755 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:39:59.239755 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e6ed242-956f-4b14-8520-18920447bf05 could not be found. Aug 10 11:39:59.239755 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:39:59.239755 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:39:59.239755 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:39:59.239755 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:39:59.239755 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:39:59.239755 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:39:59.239755 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:39:59.239755 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:39:59.239755 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:39:59.241301 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:39:59.241301 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 11:39:59.241301 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 11:39:59.241301 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 11:39:59.241301 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 11:39:59.241301 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:39:59.241301 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:39:59.241301 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:39:59.241301 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:39:59.241301 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e6ed242-956f-4b14-8520-18920447bf05 could not be found. Aug 10 11:39:59.241301 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:39:59.241301 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:39:59.241301 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:39:59.241301 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:39:59.241301 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:39:59.241301 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:39:59.241301 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:39:59.241301 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:39:59.241301 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e6ed242-956f-4b14-8520-18920447bf05 could not be found. Aug 10 11:39:59.241301 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:39:59.242768 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-9d44c9f4-9e03-450b-89ec-4e9a32e3f294 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Returning 404 to user: Instance 9e6ed242-956f-4b14-8520-18920447bf05 could not be found. {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:39:59.242768 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-9d44c9f4-9e03-450b-89ec-4e9a32e3f294 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "DELETE /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 404 len: 111 microversion: 2.20 time: 0.030721 Aug 10 11:39:59.242768 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 389/776] 10.222.0.62 () {60 vars in 1280 bytes} [Wed Aug 10 11:39:59 2022] DELETE /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 11:39:59.246853 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-b340a951-5626-444e-812a-472d4796f6b9 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:39:59.247470 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-b340a951-5626-444e-812a-472d4796f6b9 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] [instance: 9e6ed242-956f-4b14-8520-18920447bf05] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:39:59.253363 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b340a951-5626-444e-812a-472d4796f6b9 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:59.253841 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b340a951-5626-444e-812a-472d4796f6b9 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:59.254275 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b340a951-5626-444e-812a-472d4796f6b9 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:59.254959 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b340a951-5626-444e-812a-472d4796f6b9 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:39:59.255410 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b340a951-5626-444e-812a-472d4796f6b9 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:39:59.255832 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b340a951-5626-444e-812a-472d4796f6b9 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:39:59.269567 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.wsgi [None req-b340a951-5626-444e-812a-472d4796f6b9 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] HTTP exception thrown: Instance 9e6ed242-956f-4b14-8520-18920447bf05 could not be found. Aug 10 11:39:59.271110 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-b340a951-5626-444e-812a-472d4796f6b9 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Request method failure captured: Aug 10 11:39:59.271110 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: request: GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 HTTP/1.1 Aug 10 11:39:59.271110 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Accept: application/json Aug 10 11:39:59.271110 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Aug 10 11:39:59.271110 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Connection: close Aug 10 11:39:59.271110 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Content-Length: 0 Aug 10 11:39:59.271110 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Content-Type: application/json Aug 10 11:39:59.271110 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Host: 10.222.0.62 Aug 10 11:39:59.271110 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Aug 10 11:39:59.271110 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.11 Aug 10 11:39:59.271110 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABi85dbPpkD1lR6RgeGxs20S9zIpw9_vWmHYwF3S3efUNWpa3XkvYBD_qP6zOAi-1YEMOe9G-Nqxrr80D-z8SZs034-HRTFI0Jc1vEbrcFlCMHBEnhSQC8MmaTwEs8VeOUyk0d7je2_5L6HblSoU8Ec68jOZAZkEjpVrGpZ3jFH507P8oA Aug 10 11:39:59.271110 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Aug 10 11:39:59.271110 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Aug 10 11:39:59.271110 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Aug 10 11:39:59.271110 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Aug 10 11:39:59.271110 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 11:39:59.271110 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Aug 10 11:39:59.271110 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Aug 10 11:39:59.271110 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Id: bc3366c89fa049939147e3761e0c8d1a Aug 10 11:39:59.271110 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-671694811 Aug 10 11:39:59.271110 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Role: member,reader Aug 10 11:39:59.271110 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Aug 10 11:39:59.272926 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bc3366c89fa049939147e3761e0c8d1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bc3366c89fa049939147e3761e0c8d1a", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bc3366c89fa049939147e3761e0c8d1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bc3366c89fa049939147e3761e0c8d1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:39:59.272926 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-AttachVolumeShelveTestJSON-671694811 Aug 10 11:39:59.272926 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant-Id: bc3366c89fa049939147e3761e0c8d1a Aug 10 11:39:59.272926 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-671694811 Aug 10 11:39:59.272926 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User: tempest-AttachVolumeShelveTestJSON-671694811-project Aug 10 11:39:59.272926 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Aug 10 11:39:59.272926 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Aug 10 11:39:59.272926 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Id: 84c1f36162fa4537923cd19f21bbd20c Aug 10 11:39:59.272926 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-AttachVolumeShelveTestJSON-671694811-project Aug 10 11:39:59.272926 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: method: > Aug 10 11:39:59.272926 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: exception: Instance 9e6ed242-956f-4b14-8520-18920447bf05 could not be found. Aug 10 11:39:59.272926 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: action_args: {'id': '9e6ed242-956f-4b14-8520-18920447bf05'} Aug 10 11:39:59.274063 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:39:59.274063 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:39:59.274063 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:39:59.274063 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:39:59.274063 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:39:59.274063 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:39:59.274063 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:39:59.274063 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:39:59.274063 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:39:59.274063 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:39:59.274063 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e6ed242-956f-4b14-8520-18920447bf05 could not be found. Aug 10 11:39:59.274063 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:39:59.274063 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:39:59.274063 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:39:59.274063 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:39:59.274063 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:39:59.274063 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:39:59.274063 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:39:59.274063 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:39:59.274063 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:39:59.275532 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:39:59.275532 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:39:59.275532 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:39:59.275532 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:39:59.275532 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:39:59.275532 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:39:59.275532 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:39:59.275532 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e6ed242-956f-4b14-8520-18920447bf05 could not be found. Aug 10 11:39:59.275532 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:39:59.275532 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:39:59.275532 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:39:59.275532 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:39:59.275532 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:39:59.275532 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:39:59.275532 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:39:59.275532 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:39:59.275532 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e6ed242-956f-4b14-8520-18920447bf05 could not be found. Aug 10 11:39:59.275532 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:39:59.277087 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-b340a951-5626-444e-812a-472d4796f6b9 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] Returning 404 to user: Instance 9e6ed242-956f-4b14-8520-18920447bf05 could not be found. {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:39:59.277087 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-b340a951-5626-444e-812a-472d4796f6b9 tempest-AttachVolumeShelveTestJSON-671694811 tempest-AttachVolumeShelveTestJSON-671694811-project] 10.222.0.62 "GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05" status: 404 len: 111 microversion: 2.20 time: 0.029624 Aug 10 11:39:59.277087 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 388/777] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 10 11:39:59 2022] GET /compute/v2.1/servers/9e6ed242-956f-4b14-8520-18920447bf05 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 11:40:27.863832 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f5471177-47d1-4b30-8219-3775dc5c2b50 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:40:27.864474 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-f5471177-47d1-4b30-8219-3775dc5c2b50 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:40:27.870562 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=1 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:40:27.871229 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=79 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:40:27.876008 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f5471177-47d1-4b30-8219-3775dc5c2b50 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:27.877079 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f5471177-47d1-4b30-8219-3775dc5c2b50 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:27.877605 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f5471177-47d1-4b30-8219-3775dc5c2b50 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:27.878319 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f5471177-47d1-4b30-8219-3775dc5c2b50 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:27.878809 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f5471177-47d1-4b30-8219-3775dc5c2b50 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:27.879216 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f5471177-47d1-4b30-8219-3775dc5c2b50 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:27.903678 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-f5471177-47d1-4b30-8219-3775dc5c2b50 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b/ips" status: 200 len: 150 microversion: 2.1 time: 0.044420 Aug 10 11:40:27.908229 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 390/778] 10.222.0.62 () {58 vars in 1248 bytes} [Wed Aug 10 11:40:27 2022] GET /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:40:29.722614 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-a33a65d5-ce58-4b26-aceb-6a681a8f9cfc tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e440077-a562-4374-ba3a-c9e163e42e17"}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:40:29.724947 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-a33a65d5-ce58-4b26-aceb-6a681a8f9cfc tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:40:29.727333 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:40:29.727995 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:40:29.732664 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a33a65d5-ce58-4b26-aceb-6a681a8f9cfc tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:29.736252 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a33a65d5-ce58-4b26-aceb-6a681a8f9cfc tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:29.736252 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a33a65d5-ce58-4b26-aceb-6a681a8f9cfc tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:29.736252 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a33a65d5-ce58-4b26-aceb-6a681a8f9cfc tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:29.736252 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a33a65d5-ce58-4b26-aceb-6a681a8f9cfc tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:29.736871 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a33a65d5-ce58-4b26-aceb-6a681a8f9cfc tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:30.487185 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-a33a65d5-ce58-4b26-aceb-6a681a8f9cfc tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "POST /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.768749 Aug 10 11:40:30.489600 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 389/779] 10.222.0.62 () {60 vars in 1323 bytes} [Wed Aug 10 11:40:29 2022] POST /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b/os-volume_attachments => generated 194 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:40:38.063328 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-a7f4b277-af5e-48af-bfad-8bf0707335fd tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Action: 'create', calling method: .version_select at 0x7fb7cdbf4ee0>, body: {"keypair": {"name": "tempest-keypair-369358502", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIk+i6/sIWDDS/qRlo6pLyJ8EL1xdrLZ4x3xMLPd3XvPbbqZfB8+FP4UF3S3a/nauJBMrmKV0qt0eBV62lG9oXGy0TREZ1wJne8Bm3jM7hl2EAtOnsiLNPOFkDtS0pObWw=="}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:40:38.080108 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-a7f4b277-af5e-48af-bfad-8bf0707335fd tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Getting quotas for project 1275e554301b4d019da34186581fc0da. Resources: {'key_pairs'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:40:38.084186 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-a7f4b277-af5e-48af-bfad-8bf0707335fd tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Getting quotas for user 4f61f9a578834243b0d11888c397deff and project 1275e554301b4d019da34186581fc0da. Resources: {'key_pairs'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:40:38.198393 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-a7f4b277-af5e-48af-bfad-8bf0707335fd tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.139649 Aug 10 11:40:38.199004 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 391/780] 10.222.0.62 () {60 vars in 1159 bytes} [Wed Aug 10 11:40:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:40:41.016743 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=2 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:40:41.017563 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:40:41.022115 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-c2cc3aad-ee6c-40f5-a0bc-d390ba7777c8 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1097455435", "imageRef": "99bbc441-5102-4a51-a496-cfbffeb3033a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9e8c6f11-9bc0-4d49-baa5-ecd5d8e7ec5d"}], "security_groups": [{"name": "tempest-securitygroup--420292596"}], "key_name": "tempest-keypair-369358502", "user_data": "}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:40:41.129497 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.network.neutron [None req-c2cc3aad-ee6c-40f5-a0bc-d390ba7777c8 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] validate_networks() for [('9e8c6f11-9bc0-4d49-baa5-ecd5d8e7ec5d', None, None, None, None, None)] {{(pid=124682) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:40:41.513557 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-c2cc3aad-ee6c-40f5-a0bc-d390ba7777c8 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Flavor limits 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:40:41.514005 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-c2cc3aad-ee6c-40f5-a0bc-d390ba7777c8 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Image limits 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:40:41.514478 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-c2cc3aad-ee6c-40f5-a0bc-d390ba7777c8 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Flavor pref 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:40:41.514885 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-c2cc3aad-ee6c-40f5-a0bc-d390ba7777c8 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Image pref 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:40:41.515555 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-c2cc3aad-ee6c-40f5-a0bc-d390ba7777c8 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:40:41.524900 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c2cc3aad-ee6c-40f5-a0bc-d390ba7777c8 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:41.525381 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c2cc3aad-ee6c-40f5-a0bc-d390ba7777c8 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:41.525939 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c2cc3aad-ee6c-40f5-a0bc-d390ba7777c8 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:41.526663 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c2cc3aad-ee6c-40f5-a0bc-d390ba7777c8 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:41.527113 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c2cc3aad-ee6c-40f5-a0bc-d390ba7777c8 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:41.527535 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c2cc3aad-ee6c-40f5-a0bc-d390ba7777c8 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:41.544776 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-c2cc3aad-ee6c-40f5-a0bc-d390ba7777c8 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Getting quotas for project 1275e554301b4d019da34186581fc0da. Resources: {'ram', 'instances', 'cores'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:40:41.548862 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-c2cc3aad-ee6c-40f5-a0bc-d390ba7777c8 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Getting quotas for user 4f61f9a578834243b0d11888c397deff and project 1275e554301b4d019da34186581fc0da. Resources: {'ram', 'instances', 'cores'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:40:41.559612 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-c2cc3aad-ee6c-40f5-a0bc-d390ba7777c8 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Going to run 1 instances... {{(pid=124682) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:40:41.562084 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-c2cc3aad-ee6c-40f5-a0bc-d390ba7777c8 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: aa5d857b-b50d-4b03-aadb-a4072d4c1d3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99bbc441-5102-4a51-a496-cfbffeb3033a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:40:41.712631 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-c2cc3aad-ee6c-40f5-a0bc-d390ba7777c8 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.697645 Aug 10 11:40:41.713277 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 390/781] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Aug 10 11:40:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 11:40:41.725132 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-c44573a5-7caa-4150-9c49-f06718d93ad8 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:40:41.730315 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-c44573a5-7caa-4150-9c49-f06718d93ad8 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: aa5d857b-b50d-4b03-aadb-a4072d4c1d3e] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:40:41.787359 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-c44573a5-7caa-4150-9c49-f06718d93ad8 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:40:41.795692 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-c44573a5-7caa-4150-9c49-f06718d93ad8 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/aa5d857b-b50d-4b03-aadb-a4072d4c1d3e" status: 200 len: 1241 microversion: 2.1 time: 0.074821 Aug 10 11:40:41.796292 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 392/782] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:40:41 2022] GET /compute/v2.1/servers/aa5d857b-b50d-4b03-aadb-a4072d4c1d3e => generated 1241 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:40:42.817903 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-ecf590ae-3b5a-49d4-9e29-c15a14446961 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:40:42.818737 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-ecf590ae-3b5a-49d4-9e29-c15a14446961 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: aa5d857b-b50d-4b03-aadb-a4072d4c1d3e] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:40:42.825051 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ecf590ae-3b5a-49d4-9e29-c15a14446961 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:42.825528 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ecf590ae-3b5a-49d4-9e29-c15a14446961 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:42.825962 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ecf590ae-3b5a-49d4-9e29-c15a14446961 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:42.826646 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ecf590ae-3b5a-49d4-9e29-c15a14446961 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:42.827098 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ecf590ae-3b5a-49d4-9e29-c15a14446961 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:42.827524 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ecf590ae-3b5a-49d4-9e29-c15a14446961 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:42.889593 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-ecf590ae-3b5a-49d4-9e29-c15a14446961 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:40:42.898192 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-ecf590ae-3b5a-49d4-9e29-c15a14446961 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/aa5d857b-b50d-4b03-aadb-a4072d4c1d3e" status: 200 len: 1245 microversion: 2.1 time: 0.085179 Aug 10 11:40:42.899194 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 391/783] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:40:42 2022] GET /compute/v2.1/servers/aa5d857b-b50d-4b03-aadb-a4072d4c1d3e => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:40:43.919388 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-aa4359ac-9a7b-408d-8cbc-bebbfd03764c tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:40:43.920828 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-aa4359ac-9a7b-408d-8cbc-bebbfd03764c tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: aa5d857b-b50d-4b03-aadb-a4072d4c1d3e] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:40:43.928009 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-aa4359ac-9a7b-408d-8cbc-bebbfd03764c tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:43.932283 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-aa4359ac-9a7b-408d-8cbc-bebbfd03764c tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:43.932283 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-aa4359ac-9a7b-408d-8cbc-bebbfd03764c tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:43.932283 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-aa4359ac-9a7b-408d-8cbc-bebbfd03764c tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:43.932283 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-aa4359ac-9a7b-408d-8cbc-bebbfd03764c tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:43.932653 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-aa4359ac-9a7b-408d-8cbc-bebbfd03764c tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:44.037787 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-aa4359ac-9a7b-408d-8cbc-bebbfd03764c tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:40:44.046287 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-aa4359ac-9a7b-408d-8cbc-bebbfd03764c tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/aa5d857b-b50d-4b03-aadb-a4072d4c1d3e" status: 200 len: 1311 microversion: 2.1 time: 0.130811 Aug 10 11:40:44.046931 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 393/784] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:40:43 2022] GET /compute/v2.1/servers/aa5d857b-b50d-4b03-aadb-a4072d4c1d3e => generated 1311 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:40:45.077362 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-5d017f8c-b4b9-41bb-aebd-1c0de2227217 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:40:45.078029 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-5d017f8c-b4b9-41bb-aebd-1c0de2227217 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: aa5d857b-b50d-4b03-aadb-a4072d4c1d3e] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:40:45.085133 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5d017f8c-b4b9-41bb-aebd-1c0de2227217 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:45.085647 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5d017f8c-b4b9-41bb-aebd-1c0de2227217 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:45.086086 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5d017f8c-b4b9-41bb-aebd-1c0de2227217 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:45.086785 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5d017f8c-b4b9-41bb-aebd-1c0de2227217 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:45.087272 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5d017f8c-b4b9-41bb-aebd-1c0de2227217 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:45.087692 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5d017f8c-b4b9-41bb-aebd-1c0de2227217 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:45.238677 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-5d017f8c-b4b9-41bb-aebd-1c0de2227217 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:40:45.247612 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-5d017f8c-b4b9-41bb-aebd-1c0de2227217 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/aa5d857b-b50d-4b03-aadb-a4072d4c1d3e" status: 200 len: 1366 microversion: 2.1 time: 0.180566 Aug 10 11:40:45.248218 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 392/785] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:40:45 2022] GET /compute/v2.1/servers/aa5d857b-b50d-4b03-aadb-a4072d4c1d3e => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:40:45.618765 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-4f90c9dc-8b1d-4321-8823-218faf2243ee req-bfc2158a-76aa-4259-a26d-aa2ca7f8cd15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa5d857b-b50d-4b03-aadb-a4072d4c1d3e", "tag": "a7423053-2221-4807-ad6d-4a56639d7625"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:40:45.632343 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-4f90c9dc-8b1d-4321-8823-218faf2243ee req-bfc2158a-76aa-4259-a26d-aa2ca7f8cd15 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:45.633643 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-4f90c9dc-8b1d-4321-8823-218faf2243ee req-bfc2158a-76aa-4259-a26d-aa2ca7f8cd15 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:45.633643 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-4f90c9dc-8b1d-4321-8823-218faf2243ee req-bfc2158a-76aa-4259-a26d-aa2ca7f8cd15 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:45.645603 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-4f90c9dc-8b1d-4321-8823-218faf2243ee req-bfc2158a-76aa-4259-a26d-aa2ca7f8cd15 service nova] Creating event network-changed:a7423053-2221-4807-ad6d-4a56639d7625 for instance aa5d857b-b50d-4b03-aadb-a4072d4c1d3e on hv-cinder-85272 Aug 10 11:40:45.651125 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-4f90c9dc-8b1d-4321-8823-218faf2243ee req-bfc2158a-76aa-4259-a26d-aa2ca7f8cd15 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038366 Aug 10 11:40:45.652180 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 394/786] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:40:46.269653 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-2e8d9cb8-abeb-4131-aa60-46c8b566b0f0 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:40:46.270347 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-2e8d9cb8-abeb-4131-aa60-46c8b566b0f0 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: aa5d857b-b50d-4b03-aadb-a4072d4c1d3e] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:40:46.277659 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2e8d9cb8-abeb-4131-aa60-46c8b566b0f0 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:46.278169 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2e8d9cb8-abeb-4131-aa60-46c8b566b0f0 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:46.278598 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2e8d9cb8-abeb-4131-aa60-46c8b566b0f0 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:46.279366 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2e8d9cb8-abeb-4131-aa60-46c8b566b0f0 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:46.279824 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2e8d9cb8-abeb-4131-aa60-46c8b566b0f0 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:46.280290 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2e8d9cb8-abeb-4131-aa60-46c8b566b0f0 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:46.423514 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-2e8d9cb8-abeb-4131-aa60-46c8b566b0f0 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:40:46.432072 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-2e8d9cb8-abeb-4131-aa60-46c8b566b0f0 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/aa5d857b-b50d-4b03-aadb-a4072d4c1d3e" status: 200 len: 1366 microversion: 2.1 time: 0.167319 Aug 10 11:40:46.436415 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 393/787] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:40:46 2022] GET /compute/v2.1/servers/aa5d857b-b50d-4b03-aadb-a4072d4c1d3e => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:40:47.467811 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-5676c84a-093f-4630-8c19-3982e0311ee5 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:40:47.468630 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-5676c84a-093f-4630-8c19-3982e0311ee5 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: aa5d857b-b50d-4b03-aadb-a4072d4c1d3e] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:40:47.475653 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5676c84a-093f-4630-8c19-3982e0311ee5 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:47.476176 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5676c84a-093f-4630-8c19-3982e0311ee5 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:47.482207 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5676c84a-093f-4630-8c19-3982e0311ee5 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:47.482207 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5676c84a-093f-4630-8c19-3982e0311ee5 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:47.482207 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5676c84a-093f-4630-8c19-3982e0311ee5 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:47.482207 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5676c84a-093f-4630-8c19-3982e0311ee5 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:47.612870 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-5676c84a-093f-4630-8c19-3982e0311ee5 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:40:47.620283 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-5676c84a-093f-4630-8c19-3982e0311ee5 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/aa5d857b-b50d-4b03-aadb-a4072d4c1d3e" status: 200 len: 1366 microversion: 2.1 time: 0.157312 Aug 10 11:40:47.620850 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 395/788] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:40:47 2022] GET /compute/v2.1/servers/aa5d857b-b50d-4b03-aadb-a4072d4c1d3e => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:40:48.641749 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-1528785a-2e79-4dcb-843d-7d6448c4ee40 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:40:48.642404 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-1528785a-2e79-4dcb-843d-7d6448c4ee40 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: aa5d857b-b50d-4b03-aadb-a4072d4c1d3e] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:40:48.649488 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1528785a-2e79-4dcb-843d-7d6448c4ee40 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:48.649915 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1528785a-2e79-4dcb-843d-7d6448c4ee40 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:48.650347 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1528785a-2e79-4dcb-843d-7d6448c4ee40 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:48.651069 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1528785a-2e79-4dcb-843d-7d6448c4ee40 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:48.651518 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1528785a-2e79-4dcb-843d-7d6448c4ee40 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:48.651938 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1528785a-2e79-4dcb-843d-7d6448c4ee40 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:48.800654 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-1528785a-2e79-4dcb-843d-7d6448c4ee40 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:40:48.808672 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-1528785a-2e79-4dcb-843d-7d6448c4ee40 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/aa5d857b-b50d-4b03-aadb-a4072d4c1d3e" status: 200 len: 1366 microversion: 2.1 time: 0.171011 Aug 10 11:40:48.809242 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 394/789] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:40:48 2022] GET /compute/v2.1/servers/aa5d857b-b50d-4b03-aadb-a4072d4c1d3e => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:40:49.829333 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-b065cde2-7870-4fab-bf89-a6fa7877c5cb tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:40:49.830480 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-b065cde2-7870-4fab-bf89-a6fa7877c5cb tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: aa5d857b-b50d-4b03-aadb-a4072d4c1d3e] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:40:49.836971 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b065cde2-7870-4fab-bf89-a6fa7877c5cb tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:49.837447 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b065cde2-7870-4fab-bf89-a6fa7877c5cb tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:49.837874 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b065cde2-7870-4fab-bf89-a6fa7877c5cb tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:49.838559 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b065cde2-7870-4fab-bf89-a6fa7877c5cb tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:49.839010 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b065cde2-7870-4fab-bf89-a6fa7877c5cb tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:49.839430 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b065cde2-7870-4fab-bf89-a6fa7877c5cb tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:50.053881 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-b065cde2-7870-4fab-bf89-a6fa7877c5cb tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:40:50.062344 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-b065cde2-7870-4fab-bf89-a6fa7877c5cb tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/aa5d857b-b50d-4b03-aadb-a4072d4c1d3e" status: 200 len: 1366 microversion: 2.1 time: 0.236743 Aug 10 11:40:50.062914 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 396/790] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:40:49 2022] GET /compute/v2.1/servers/aa5d857b-b50d-4b03-aadb-a4072d4c1d3e => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:40:51.083146 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-1dd4f6b0-8a47-43a3-8a51-75dfb699f436 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:40:51.083936 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-1dd4f6b0-8a47-43a3-8a51-75dfb699f436 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: aa5d857b-b50d-4b03-aadb-a4072d4c1d3e] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:40:51.090346 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1dd4f6b0-8a47-43a3-8a51-75dfb699f436 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:51.090979 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1dd4f6b0-8a47-43a3-8a51-75dfb699f436 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:51.091822 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1dd4f6b0-8a47-43a3-8a51-75dfb699f436 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:51.092781 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1dd4f6b0-8a47-43a3-8a51-75dfb699f436 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:51.093460 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1dd4f6b0-8a47-43a3-8a51-75dfb699f436 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:51.094108 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1dd4f6b0-8a47-43a3-8a51-75dfb699f436 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:51.247717 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-1dd4f6b0-8a47-43a3-8a51-75dfb699f436 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:40:51.256465 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-1dd4f6b0-8a47-43a3-8a51-75dfb699f436 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/aa5d857b-b50d-4b03-aadb-a4072d4c1d3e" status: 200 len: 1366 microversion: 2.1 time: 0.177393 Aug 10 11:40:51.257042 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 395/791] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:40:51 2022] GET /compute/v2.1/servers/aa5d857b-b50d-4b03-aadb-a4072d4c1d3e => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:40:51.476982 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-59a6b67d-5e01-4f7d-8cb7-f454686f9b53 req-3a5b569b-7134-4c65-a429-af4895e8c32f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa5d857b-b50d-4b03-aadb-a4072d4c1d3e", "name": "network-vif-plugged", "status": "completed", "tag": "a7423053-2221-4807-ad6d-4a56639d7625"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:40:51.488049 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-59a6b67d-5e01-4f7d-8cb7-f454686f9b53 req-3a5b569b-7134-4c65-a429-af4895e8c32f service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:51.488683 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-59a6b67d-5e01-4f7d-8cb7-f454686f9b53 req-3a5b569b-7134-4c65-a429-af4895e8c32f service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:51.489220 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-59a6b67d-5e01-4f7d-8cb7-f454686f9b53 req-3a5b569b-7134-4c65-a429-af4895e8c32f service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:51.500625 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-59a6b67d-5e01-4f7d-8cb7-f454686f9b53 req-3a5b569b-7134-4c65-a429-af4895e8c32f service nova] Creating event network-vif-plugged:a7423053-2221-4807-ad6d-4a56639d7625 for instance aa5d857b-b50d-4b03-aadb-a4072d4c1d3e on hv-cinder-85272 Aug 10 11:40:51.507113 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-59a6b67d-5e01-4f7d-8cb7-f454686f9b53 req-3a5b569b-7134-4c65-a429-af4895e8c32f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033748 Aug 10 11:40:51.508159 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 397/792] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:40:52.277157 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-94f4b9f4-9f7d-4663-95be-0b528f2bfe77 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:40:52.278341 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-94f4b9f4-9f7d-4663-95be-0b528f2bfe77 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: aa5d857b-b50d-4b03-aadb-a4072d4c1d3e] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:40:52.280453 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=2 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:40:52.281470 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=6 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:40:52.287707 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-94f4b9f4-9f7d-4663-95be-0b528f2bfe77 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:52.288507 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-94f4b9f4-9f7d-4663-95be-0b528f2bfe77 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:52.289115 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-94f4b9f4-9f7d-4663-95be-0b528f2bfe77 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:52.289821 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-94f4b9f4-9f7d-4663-95be-0b528f2bfe77 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:52.290274 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-94f4b9f4-9f7d-4663-95be-0b528f2bfe77 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:52.290700 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-94f4b9f4-9f7d-4663-95be-0b528f2bfe77 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:52.499159 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-94f4b9f4-9f7d-4663-95be-0b528f2bfe77 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:40:52.511708 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-94f4b9f4-9f7d-4663-95be-0b528f2bfe77 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/aa5d857b-b50d-4b03-aadb-a4072d4c1d3e" status: 200 len: 1366 microversion: 2.1 time: 0.238291 Aug 10 11:40:52.512348 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 396/793] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:40:52 2022] GET /compute/v2.1/servers/aa5d857b-b50d-4b03-aadb-a4072d4c1d3e => generated 1366 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:40:53.533859 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-22805ea1-8a0a-4faa-a265-b32dd30dac59 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:40:53.534556 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-22805ea1-8a0a-4faa-a265-b32dd30dac59 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: aa5d857b-b50d-4b03-aadb-a4072d4c1d3e] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:40:53.537999 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=6 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:40:53.551914 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-22805ea1-8a0a-4faa-a265-b32dd30dac59 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:53.552752 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-22805ea1-8a0a-4faa-a265-b32dd30dac59 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:53.553250 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-22805ea1-8a0a-4faa-a265-b32dd30dac59 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:53.554149 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-22805ea1-8a0a-4faa-a265-b32dd30dac59 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:53.554608 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-22805ea1-8a0a-4faa-a265-b32dd30dac59 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:53.555188 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-22805ea1-8a0a-4faa-a265-b32dd30dac59 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:53.800871 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-22805ea1-8a0a-4faa-a265-b32dd30dac59 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:40:53.810528 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-22805ea1-8a0a-4faa-a265-b32dd30dac59 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/aa5d857b-b50d-4b03-aadb-a4072d4c1d3e" status: 200 len: 1556 microversion: 2.1 time: 0.280885 Aug 10 11:40:53.811115 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 398/794] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:40:53 2022] GET /compute/v2.1/servers/aa5d857b-b50d-4b03-aadb-a4072d4c1d3e => generated 1556 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:40:53.837547 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-35b6f425-9db4-4deb-9a07-b309a120d390 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:40:53.838109 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-35b6f425-9db4-4deb-9a07-b309a120d390 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: aa5d857b-b50d-4b03-aadb-a4072d4c1d3e] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:40:53.844870 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-35b6f425-9db4-4deb-9a07-b309a120d390 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:53.845480 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-35b6f425-9db4-4deb-9a07-b309a120d390 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:53.846005 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-35b6f425-9db4-4deb-9a07-b309a120d390 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:53.846710 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-35b6f425-9db4-4deb-9a07-b309a120d390 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:53.847478 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-35b6f425-9db4-4deb-9a07-b309a120d390 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:53.847919 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-35b6f425-9db4-4deb-9a07-b309a120d390 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:53.930057 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-35b6f425-9db4-4deb-9a07-b309a120d390 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/aa5d857b-b50d-4b03-aadb-a4072d4c1d3e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097100 Aug 10 11:40:53.930616 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 397/795] 10.222.0.62 () {58 vars in 1275 bytes} [Wed Aug 10 11:40:53 2022] GET /compute/v2.1/servers/aa5d857b-b50d-4b03-aadb-a4072d4c1d3e/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:40:55.278099 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-7f36a1c5-d7c6-4f74-88b3-5958eca6a6b9 req-b45ac29e-77d3-496d-9145-448dff661843 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa5d857b-b50d-4b03-aadb-a4072d4c1d3e", "tag": "a7423053-2221-4807-ad6d-4a56639d7625"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:40:55.291782 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-7f36a1c5-d7c6-4f74-88b3-5958eca6a6b9 req-b45ac29e-77d3-496d-9145-448dff661843 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:55.292493 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-7f36a1c5-d7c6-4f74-88b3-5958eca6a6b9 req-b45ac29e-77d3-496d-9145-448dff661843 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:55.293075 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-7f36a1c5-d7c6-4f74-88b3-5958eca6a6b9 req-b45ac29e-77d3-496d-9145-448dff661843 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:55.304729 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-7f36a1c5-d7c6-4f74-88b3-5958eca6a6b9 req-b45ac29e-77d3-496d-9145-448dff661843 service nova] Creating event network-changed:a7423053-2221-4807-ad6d-4a56639d7625 for instance aa5d857b-b50d-4b03-aadb-a4072d4c1d3e on hv-cinder-85272 Aug 10 11:40:55.310198 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-7f36a1c5-d7c6-4f74-88b3-5958eca6a6b9 req-b45ac29e-77d3-496d-9145-448dff661843 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035875 Aug 10 11:40:55.311336 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 399/796] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:40:59.931509 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-a8bf9941-b5f1-4a63-8748-4fea8533fb1e tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Action: 'create', calling method: .version_select at 0x7fb7ce4920d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1775361532", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLSRg53a63dO7rTK2UtnJN70u37LSpdhyamO7u5qSy5nGm9efJRTYA2rthYE0IqVlhHG0Ml8xA6xJI7f5J8dz+P7kcyKdUudhOWAVWgS8ELyD633Y2gXc4Hpd27JKF8lNA=="}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:40:59.950084 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-a8bf9941-b5f1-4a63-8748-4fea8533fb1e tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Getting quotas for project 5d656a5891ea40268b8be271b4cc7aa2. Resources: {'key_pairs'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:40:59.963212 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-a8bf9941-b5f1-4a63-8748-4fea8533fb1e tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Getting quotas for user b6c1ca0941b2455995640460a2027f19 and project 5d656a5891ea40268b8be271b4cc7aa2. Resources: {'key_pairs'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:41:00.037812 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-a8bf9941-b5f1-4a63-8748-4fea8533fb1e tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.329083 Aug 10 11:41:00.038511 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 398/797] 10.222.0.62 () {60 vars in 1159 bytes} [Wed Aug 10 11:40:59 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:41:12.700494 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:41:12.701319 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=34 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:41:12.705997 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-d9630ade-cb6b-4a5a-a32b-983c703d30e1 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-119455234", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1346196899", "security_groups": [{"name": "tempest-secgroup-smoke-1297018732"}], "block_device_mapping_v2": [{"uuid": "98b521c5-5566-4b12-b48a-8aae1657fbea", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0d452e82-3b0d-4e6a-b6c3-744763a38d5a"}]}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:41:12.826720 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.network.neutron [None req-d9630ade-cb6b-4a5a-a32b-983c703d30e1 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] validate_networks() for [('0d452e82-3b0d-4e6a-b6c3-744763a38d5a', None, None, None, None, None)] {{(pid=124683) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:41:13.194721 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-d9630ade-cb6b-4a5a-a32b-983c703d30e1 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Flavor limits 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:41:13.195146 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-d9630ade-cb6b-4a5a-a32b-983c703d30e1 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Image limits 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:41:13.195622 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-d9630ade-cb6b-4a5a-a32b-983c703d30e1 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Flavor pref 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:41:13.196060 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-d9630ade-cb6b-4a5a-a32b-983c703d30e1 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Image pref 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:41:13.196471 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-d9630ade-cb6b-4a5a-a32b-983c703d30e1 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:41:13.205263 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d9630ade-cb6b-4a5a-a32b-983c703d30e1 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:13.205742 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d9630ade-cb6b-4a5a-a32b-983c703d30e1 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:13.206180 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d9630ade-cb6b-4a5a-a32b-983c703d30e1 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:13.206901 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d9630ade-cb6b-4a5a-a32b-983c703d30e1 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:13.207351 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d9630ade-cb6b-4a5a-a32b-983c703d30e1 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:13.207792 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d9630ade-cb6b-4a5a-a32b-983c703d30e1 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:13.224586 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-d9630ade-cb6b-4a5a-a32b-983c703d30e1 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Getting quotas for project 1c9f7b60a16e438a89c4f7248707ae2d. Resources: {'ram', 'instances', 'cores'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:41:13.229288 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-d9630ade-cb6b-4a5a-a32b-983c703d30e1 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Getting quotas for user 83d48f0f35644f23a0fc2216e5ec5a2c and project 1c9f7b60a16e438a89c4f7248707ae2d. Resources: {'ram', 'instances', 'cores'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:41:13.287540 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-d9630ade-cb6b-4a5a-a32b-983c703d30e1 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Going to run 1 instances... {{(pid=124683) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:41:13.289768 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-d9630ade-cb6b-4a5a-a32b-983c703d30e1 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: e014e560-1308-466b-9b93-725098e79f2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='98b521c5-5566-4b12-b48a-8aae1657fbea',volume_size=None,volume_type=None)] {{(pid=124683) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:41:13.706091 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-d9630ade-cb6b-4a5a-a32b-983c703d30e1 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.007068 Aug 10 11:41:13.707032 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 400/798] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Aug 10 11:41:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 1009 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 11:41:13.715040 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=42 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:41:13.715803 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=4 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:41:13.716527 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=4 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:41:13.726927 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-8ac34270-314f-4993-86f0-90bd86aae1bd tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:13.727633 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-8ac34270-314f-4993-86f0-90bd86aae1bd tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: e014e560-1308-466b-9b93-725098e79f2d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:13.787831 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-8ac34270-314f-4993-86f0-90bd86aae1bd tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:41:13.794328 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-8ac34270-314f-4993-86f0-90bd86aae1bd tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/e014e560-1308-466b-9b93-725098e79f2d" status: 200 len: 1094 microversion: 2.1 time: 0.080519 Aug 10 11:41:13.794900 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 399/799] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:41:13 2022] GET /compute/v2.1/servers/e014e560-1308-466b-9b93-725098e79f2d => generated 1094 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:41:14.816820 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-e1d852f2-1039-4f90-97a6-ec42f8be4631 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:14.817432 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-e1d852f2-1039-4f90-97a6-ec42f8be4631 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: e014e560-1308-466b-9b93-725098e79f2d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:14.823618 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e1d852f2-1039-4f90-97a6-ec42f8be4631 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:14.824145 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e1d852f2-1039-4f90-97a6-ec42f8be4631 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:14.824612 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e1d852f2-1039-4f90-97a6-ec42f8be4631 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:14.825322 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e1d852f2-1039-4f90-97a6-ec42f8be4631 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:14.825778 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e1d852f2-1039-4f90-97a6-ec42f8be4631 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:14.826206 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e1d852f2-1039-4f90-97a6-ec42f8be4631 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:14.889439 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-e1d852f2-1039-4f90-97a6-ec42f8be4631 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:41:14.895004 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-e1d852f2-1039-4f90-97a6-ec42f8be4631 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/e014e560-1308-466b-9b93-725098e79f2d" status: 200 len: 1144 microversion: 2.1 time: 0.083270 Aug 10 11:41:14.895580 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 401/800] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:41:14 2022] GET /compute/v2.1/servers/e014e560-1308-466b-9b93-725098e79f2d => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:41:15.918302 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-b47e8189-8e9a-47c7-8391-224580e2e3c2 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:15.919194 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-b47e8189-8e9a-47c7-8391-224580e2e3c2 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: e014e560-1308-466b-9b93-725098e79f2d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:15.927763 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b47e8189-8e9a-47c7-8391-224580e2e3c2 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:15.928640 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b47e8189-8e9a-47c7-8391-224580e2e3c2 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:15.929434 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b47e8189-8e9a-47c7-8391-224580e2e3c2 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:15.930156 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b47e8189-8e9a-47c7-8391-224580e2e3c2 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:15.930627 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b47e8189-8e9a-47c7-8391-224580e2e3c2 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:15.931746 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b47e8189-8e9a-47c7-8391-224580e2e3c2 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:15.997452 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b47e8189-8e9a-47c7-8391-224580e2e3c2 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:41:16.005840 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-b47e8189-8e9a-47c7-8391-224580e2e3c2 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/e014e560-1308-466b-9b93-725098e79f2d" status: 200 len: 1210 microversion: 2.1 time: 0.093342 Aug 10 11:41:16.006500 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 400/801] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:41:15 2022] GET /compute/v2.1/servers/e014e560-1308-466b-9b93-725098e79f2d => generated 1210 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:41:17.027503 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-805d2fc4-9892-4714-9430-342f572d312b tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:17.028177 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-805d2fc4-9892-4714-9430-342f572d312b tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: e014e560-1308-466b-9b93-725098e79f2d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:17.035584 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-805d2fc4-9892-4714-9430-342f572d312b tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:17.036225 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-805d2fc4-9892-4714-9430-342f572d312b tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:17.036611 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-805d2fc4-9892-4714-9430-342f572d312b tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:17.037342 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-805d2fc4-9892-4714-9430-342f572d312b tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:17.037808 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-805d2fc4-9892-4714-9430-342f572d312b tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:17.038238 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-805d2fc4-9892-4714-9430-342f572d312b tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:17.260116 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-805d2fc4-9892-4714-9430-342f572d312b tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:41:17.267992 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-805d2fc4-9892-4714-9430-342f572d312b tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/e014e560-1308-466b-9b93-725098e79f2d" status: 200 len: 1266 microversion: 2.1 time: 0.244388 Aug 10 11:41:17.268570 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 402/802] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:41:17 2022] GET /compute/v2.1/servers/e014e560-1308-466b-9b93-725098e79f2d => generated 1266 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:41:17.396067 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-95484f59-1c95-4cac-a101-048452edc378 req-3d188cfc-c56e-44f7-8f7f-bc1633695f9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e014e560-1308-466b-9b93-725098e79f2d", "tag": "7f280e4b-4e93-4664-bfaf-0861417f39b6"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:41:17.405894 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-95484f59-1c95-4cac-a101-048452edc378 req-3d188cfc-c56e-44f7-8f7f-bc1633695f9f service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:17.406377 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-95484f59-1c95-4cac-a101-048452edc378 req-3d188cfc-c56e-44f7-8f7f-bc1633695f9f service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:17.407366 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-95484f59-1c95-4cac-a101-048452edc378 req-3d188cfc-c56e-44f7-8f7f-bc1633695f9f service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:17.418532 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-95484f59-1c95-4cac-a101-048452edc378 req-3d188cfc-c56e-44f7-8f7f-bc1633695f9f service nova] Creating event network-changed:7f280e4b-4e93-4664-bfaf-0861417f39b6 for instance e014e560-1308-466b-9b93-725098e79f2d on hv-cinder-85272 Aug 10 11:41:17.424284 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-95484f59-1c95-4cac-a101-048452edc378 req-3d188cfc-c56e-44f7-8f7f-bc1633695f9f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032223 Aug 10 11:41:17.424900 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 401/803] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:41:18.289027 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-7427dbc8-a3fd-410f-b940-85a2a4a457ae tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:18.289646 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-7427dbc8-a3fd-410f-b940-85a2a4a457ae tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: e014e560-1308-466b-9b93-725098e79f2d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:18.297748 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7427dbc8-a3fd-410f-b940-85a2a4a457ae tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:18.298235 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7427dbc8-a3fd-410f-b940-85a2a4a457ae tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:18.299396 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7427dbc8-a3fd-410f-b940-85a2a4a457ae tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:18.300275 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7427dbc8-a3fd-410f-b940-85a2a4a457ae tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:18.300809 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7427dbc8-a3fd-410f-b940-85a2a4a457ae tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:18.301267 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7427dbc8-a3fd-410f-b940-85a2a4a457ae tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:18.444255 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-7427dbc8-a3fd-410f-b940-85a2a4a457ae tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:41:18.451559 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-7427dbc8-a3fd-410f-b940-85a2a4a457ae tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/e014e560-1308-466b-9b93-725098e79f2d" status: 200 len: 1266 microversion: 2.1 time: 0.166408 Aug 10 11:41:18.452153 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 403/804] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:41:18 2022] GET /compute/v2.1/servers/e014e560-1308-466b-9b93-725098e79f2d => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:41:19.474367 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-3bfb0d64-4ae0-4b83-8896-6e9f0e727d14 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:19.474993 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-3bfb0d64-4ae0-4b83-8896-6e9f0e727d14 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: e014e560-1308-466b-9b93-725098e79f2d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:19.481237 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3bfb0d64-4ae0-4b83-8896-6e9f0e727d14 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:19.481721 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3bfb0d64-4ae0-4b83-8896-6e9f0e727d14 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:19.482162 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3bfb0d64-4ae0-4b83-8896-6e9f0e727d14 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:19.482848 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3bfb0d64-4ae0-4b83-8896-6e9f0e727d14 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:19.483302 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3bfb0d64-4ae0-4b83-8896-6e9f0e727d14 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:19.483732 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3bfb0d64-4ae0-4b83-8896-6e9f0e727d14 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:19.837570 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-3bfb0d64-4ae0-4b83-8896-6e9f0e727d14 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:41:19.845908 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-3bfb0d64-4ae0-4b83-8896-6e9f0e727d14 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/e014e560-1308-466b-9b93-725098e79f2d" status: 200 len: 1266 microversion: 2.1 time: 0.376462 Aug 10 11:41:19.846464 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 402/805] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:41:19 2022] GET /compute/v2.1/servers/e014e560-1308-466b-9b93-725098e79f2d => generated 1266 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:41:19.999310 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-1db331ec-8b5d-4a28-87a0-0b9c578e6c05 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-851631459", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1775361532", "security_groups": [{"name": "tempest-secgroup-smoke-1437021378"}], "networks": [{"uuid": "f7bdb45c-d0f3-4cf1-90b2-2d0be4e49831"}], "block_device_mapping_v2": [{"uuid": "c216bac1-8239-469e-a061-1a8f8429aea0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:41:20.110806 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.network.neutron [None req-1db331ec-8b5d-4a28-87a0-0b9c578e6c05 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] validate_networks() for [('f7bdb45c-d0f3-4cf1-90b2-2d0be4e49831', None, None, None, None, None)] {{(pid=124683) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:41:20.488167 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-1db331ec-8b5d-4a28-87a0-0b9c578e6c05 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Flavor limits 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:41:20.488596 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-1db331ec-8b5d-4a28-87a0-0b9c578e6c05 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Image limits 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:41:20.489125 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-1db331ec-8b5d-4a28-87a0-0b9c578e6c05 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Flavor pref 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:41:20.489467 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-1db331ec-8b5d-4a28-87a0-0b9c578e6c05 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Image pref 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:41:20.489870 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-1db331ec-8b5d-4a28-87a0-0b9c578e6c05 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:41:20.498550 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1db331ec-8b5d-4a28-87a0-0b9c578e6c05 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:20.499028 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1db331ec-8b5d-4a28-87a0-0b9c578e6c05 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:20.499455 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1db331ec-8b5d-4a28-87a0-0b9c578e6c05 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:20.500205 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1db331ec-8b5d-4a28-87a0-0b9c578e6c05 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:20.501172 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1db331ec-8b5d-4a28-87a0-0b9c578e6c05 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:20.501681 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1db331ec-8b5d-4a28-87a0-0b9c578e6c05 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:20.518505 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-1db331ec-8b5d-4a28-87a0-0b9c578e6c05 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Getting quotas for project 5d656a5891ea40268b8be271b4cc7aa2. Resources: {'ram', 'instances', 'cores'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:41:20.522352 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-1db331ec-8b5d-4a28-87a0-0b9c578e6c05 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Getting quotas for user b6c1ca0941b2455995640460a2027f19 and project 5d656a5891ea40268b8be271b4cc7aa2. Resources: {'ram', 'instances', 'cores'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:41:20.578650 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-1db331ec-8b5d-4a28-87a0-0b9c578e6c05 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Going to run 1 instances... {{(pid=124683) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:41:20.581944 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-1db331ec-8b5d-4a28-87a0-0b9c578e6c05 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c216bac1-8239-469e-a061-1a8f8429aea0',volume_size=None,volume_type=None)] {{(pid=124683) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:41:20.866342 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-ddaa93d4-c7c8-4a7a-b08a-7161a0cc41cf tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:20.867032 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-ddaa93d4-c7c8-4a7a-b08a-7161a0cc41cf tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: e014e560-1308-466b-9b93-725098e79f2d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:20.873627 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ddaa93d4-c7c8-4a7a-b08a-7161a0cc41cf tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:20.874222 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ddaa93d4-c7c8-4a7a-b08a-7161a0cc41cf tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:20.874804 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ddaa93d4-c7c8-4a7a-b08a-7161a0cc41cf tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:20.875512 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ddaa93d4-c7c8-4a7a-b08a-7161a0cc41cf tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:20.876706 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ddaa93d4-c7c8-4a7a-b08a-7161a0cc41cf tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:20.877166 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ddaa93d4-c7c8-4a7a-b08a-7161a0cc41cf tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:20.974278 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-1db331ec-8b5d-4a28-87a0-0b9c578e6c05 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.978764 Aug 10 11:41:20.975522 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 404/806] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Aug 10 11:41:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 981 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 11:41:20.985924 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f762c357-9286-4bba-b241-137cdbe20ab8 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:20.986808 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-f762c357-9286-4bba-b241-137cdbe20ab8 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:21.012844 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-ddaa93d4-c7c8-4a7a-b08a-7161a0cc41cf tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:41:21.026665 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-ddaa93d4-c7c8-4a7a-b08a-7161a0cc41cf tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/e014e560-1308-466b-9b93-725098e79f2d" status: 200 len: 1266 microversion: 2.1 time: 0.164259 Aug 10 11:41:21.027680 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 403/807] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:41:20 2022] GET /compute/v2.1/servers/e014e560-1308-466b-9b93-725098e79f2d => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:41:21.049744 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-f762c357-9286-4bba-b241-137cdbe20ab8 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c1ca0941b2455995640460a2027f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d656a5891ea40268b8be271b4cc7aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:41:21.055769 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-f762c357-9286-4bba-b241-137cdbe20ab8 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9" status: 200 len: 1088 microversion: 2.1 time: 0.073798 Aug 10 11:41:21.056410 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 405/808] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:41:20 2022] GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9 => generated 1088 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:41:22.048578 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-ad1f6a85-28eb-462d-81d9-090d7a64d27d tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:22.049249 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-ad1f6a85-28eb-462d-81d9-090d7a64d27d tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: e014e560-1308-466b-9b93-725098e79f2d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:22.055614 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ad1f6a85-28eb-462d-81d9-090d7a64d27d tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:22.056167 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ad1f6a85-28eb-462d-81d9-090d7a64d27d tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:22.056602 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ad1f6a85-28eb-462d-81d9-090d7a64d27d tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:22.057296 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ad1f6a85-28eb-462d-81d9-090d7a64d27d tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:22.057764 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ad1f6a85-28eb-462d-81d9-090d7a64d27d tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:22.058193 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ad1f6a85-28eb-462d-81d9-090d7a64d27d tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:22.076453 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f540eb47-1e54-470d-ae35-784a6ab1a117 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:22.077165 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-f540eb47-1e54-470d-ae35-784a6ab1a117 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:22.084486 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f540eb47-1e54-470d-ae35-784a6ab1a117 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:22.085083 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f540eb47-1e54-470d-ae35-784a6ab1a117 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:22.085588 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f540eb47-1e54-470d-ae35-784a6ab1a117 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:22.086348 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f540eb47-1e54-470d-ae35-784a6ab1a117 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:22.086876 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f540eb47-1e54-470d-ae35-784a6ab1a117 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:22.087369 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f540eb47-1e54-470d-ae35-784a6ab1a117 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:22.152222 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-f540eb47-1e54-470d-ae35-784a6ab1a117 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c1ca0941b2455995640460a2027f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d656a5891ea40268b8be271b4cc7aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:41:22.160467 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-f540eb47-1e54-470d-ae35-784a6ab1a117 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9" status: 200 len: 1138 microversion: 2.1 time: 0.087766 Aug 10 11:41:22.161028 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 406/809] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:41:22 2022] GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9 => generated 1138 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:41:22.201543 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-ad1f6a85-28eb-462d-81d9-090d7a64d27d tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:41:22.207701 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-ad1f6a85-28eb-462d-81d9-090d7a64d27d tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/e014e560-1308-466b-9b93-725098e79f2d" status: 200 len: 1266 microversion: 2.1 time: 0.163133 Aug 10 11:41:22.208316 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 404/810] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:41:22 2022] GET /compute/v2.1/servers/e014e560-1308-466b-9b93-725098e79f2d => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:41:23.181301 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-b2759fd2-6a18-4825-a3e4-961b8d1e161c tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:23.182548 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-b2759fd2-6a18-4825-a3e4-961b8d1e161c tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:23.190229 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b2759fd2-6a18-4825-a3e4-961b8d1e161c tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:23.190720 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b2759fd2-6a18-4825-a3e4-961b8d1e161c tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:23.191161 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b2759fd2-6a18-4825-a3e4-961b8d1e161c tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:23.191864 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b2759fd2-6a18-4825-a3e4-961b8d1e161c tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:23.192318 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b2759fd2-6a18-4825-a3e4-961b8d1e161c tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:23.192778 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b2759fd2-6a18-4825-a3e4-961b8d1e161c tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:23.232568 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-86f48f52-e6b6-4fe9-b556-d46c5917e01a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:23.246558 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-86f48f52-e6b6-4fe9-b556-d46c5917e01a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: e014e560-1308-466b-9b93-725098e79f2d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:23.253967 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-86f48f52-e6b6-4fe9-b556-d46c5917e01a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:23.254772 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-86f48f52-e6b6-4fe9-b556-d46c5917e01a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:23.255217 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-86f48f52-e6b6-4fe9-b556-d46c5917e01a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:23.256130 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-86f48f52-e6b6-4fe9-b556-d46c5917e01a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:23.256754 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-86f48f52-e6b6-4fe9-b556-d46c5917e01a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:23.257378 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-86f48f52-e6b6-4fe9-b556-d46c5917e01a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:23.287467 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-b2759fd2-6a18-4825-a3e4-961b8d1e161c tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c1ca0941b2455995640460a2027f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d656a5891ea40268b8be271b4cc7aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:41:23.299196 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-b2759fd2-6a18-4825-a3e4-961b8d1e161c tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9" status: 200 len: 1204 microversion: 2.1 time: 0.121789 Aug 10 11:41:23.300204 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 407/811] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:41:23 2022] GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9 => generated 1204 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:41:23.401445 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-86f48f52-e6b6-4fe9-b556-d46c5917e01a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:41:23.409611 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-86f48f52-e6b6-4fe9-b556-d46c5917e01a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/e014e560-1308-466b-9b93-725098e79f2d" status: 200 len: 1266 microversion: 2.1 time: 0.181545 Aug 10 11:41:23.410191 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 405/812] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:41:23 2022] GET /compute/v2.1/servers/e014e560-1308-466b-9b93-725098e79f2d => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:41:24.320463 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-821eec34-c344-49b7-8f65-5da074067f6b tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:24.321074 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-821eec34-c344-49b7-8f65-5da074067f6b tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:24.327784 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-821eec34-c344-49b7-8f65-5da074067f6b tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:24.328319 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-821eec34-c344-49b7-8f65-5da074067f6b tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:24.328893 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-821eec34-c344-49b7-8f65-5da074067f6b tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:24.329608 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-821eec34-c344-49b7-8f65-5da074067f6b tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:24.330096 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-821eec34-c344-49b7-8f65-5da074067f6b tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:24.330521 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-821eec34-c344-49b7-8f65-5da074067f6b tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:24.431036 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-68492dfc-963b-48ee-af89-0af98994d5d1 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:24.431868 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-68492dfc-963b-48ee-af89-0af98994d5d1 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: e014e560-1308-466b-9b93-725098e79f2d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:24.444123 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-68492dfc-963b-48ee-af89-0af98994d5d1 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:24.444123 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-68492dfc-963b-48ee-af89-0af98994d5d1 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:24.444123 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-68492dfc-963b-48ee-af89-0af98994d5d1 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:24.444123 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-68492dfc-963b-48ee-af89-0af98994d5d1 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:24.444701 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-68492dfc-963b-48ee-af89-0af98994d5d1 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:24.444701 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-68492dfc-963b-48ee-af89-0af98994d5d1 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:24.586645 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-68492dfc-963b-48ee-af89-0af98994d5d1 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:41:24.594876 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-68492dfc-963b-48ee-af89-0af98994d5d1 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/e014e560-1308-466b-9b93-725098e79f2d" status: 200 len: 1266 microversion: 2.1 time: 0.167992 Aug 10 11:41:24.596042 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 406/813] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:41:24 2022] GET /compute/v2.1/servers/e014e560-1308-466b-9b93-725098e79f2d => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:41:24.852130 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-821eec34-c344-49b7-8f65-5da074067f6b tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c1ca0941b2455995640460a2027f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d656a5891ea40268b8be271b4cc7aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:41:24.859577 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-821eec34-c344-49b7-8f65-5da074067f6b tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9" status: 200 len: 1272 microversion: 2.1 time: 0.543111 Aug 10 11:41:24.860906 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 408/814] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:41:24 2022] GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9 => generated 1272 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:41:25.356864 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-f83f1f8b-df74-434c-89dc-0cf1b60a0914 req-58325fe3-f822-4bc5-a826-7bd7aebd0794 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dd20638-cdb6-4db7-a23e-c98c00e103d9", "tag": "2743679b-eeea-46d5-a860-adc80ef124b6"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:41:25.366413 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-f83f1f8b-df74-434c-89dc-0cf1b60a0914 req-58325fe3-f822-4bc5-a826-7bd7aebd0794 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:25.366888 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-f83f1f8b-df74-434c-89dc-0cf1b60a0914 req-58325fe3-f822-4bc5-a826-7bd7aebd0794 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:25.367312 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-f83f1f8b-df74-434c-89dc-0cf1b60a0914 req-58325fe3-f822-4bc5-a826-7bd7aebd0794 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:25.377956 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-f83f1f8b-df74-434c-89dc-0cf1b60a0914 req-58325fe3-f822-4bc5-a826-7bd7aebd0794 service nova] Creating event network-changed:2743679b-eeea-46d5-a860-adc80ef124b6 for instance 2dd20638-cdb6-4db7-a23e-c98c00e103d9 on hv-cinder-85272 Aug 10 11:41:25.382841 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-f83f1f8b-df74-434c-89dc-0cf1b60a0914 req-58325fe3-f822-4bc5-a826-7bd7aebd0794 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029686 Aug 10 11:41:25.383581 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 407/815] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:41:25.616452 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-49f845b1-1215-49c6-b72d-0f4d4f429bee tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:25.617159 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-49f845b1-1215-49c6-b72d-0f4d4f429bee tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: e014e560-1308-466b-9b93-725098e79f2d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:25.623476 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-49f845b1-1215-49c6-b72d-0f4d4f429bee tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:25.624063 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-49f845b1-1215-49c6-b72d-0f4d4f429bee tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:25.624501 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-49f845b1-1215-49c6-b72d-0f4d4f429bee tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:25.625190 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-49f845b1-1215-49c6-b72d-0f4d4f429bee tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:25.626351 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-49f845b1-1215-49c6-b72d-0f4d4f429bee tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:25.626784 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-49f845b1-1215-49c6-b72d-0f4d4f429bee tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:25.858468 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-49f845b1-1215-49c6-b72d-0f4d4f429bee tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:41:25.865935 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-49f845b1-1215-49c6-b72d-0f4d4f429bee tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/e014e560-1308-466b-9b93-725098e79f2d" status: 200 len: 1266 microversion: 2.1 time: 0.253356 Aug 10 11:41:25.866512 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 409/816] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:41:25 2022] GET /compute/v2.1/servers/e014e560-1308-466b-9b93-725098e79f2d => generated 1266 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:41:25.883025 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-71af2db2-cdc3-4a4d-bd03-49b56e9990c4 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:25.883825 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-71af2db2-cdc3-4a4d-bd03-49b56e9990c4 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:25.890315 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-71af2db2-cdc3-4a4d-bd03-49b56e9990c4 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:25.890881 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-71af2db2-cdc3-4a4d-bd03-49b56e9990c4 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:25.891890 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-71af2db2-cdc3-4a4d-bd03-49b56e9990c4 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:25.892624 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-71af2db2-cdc3-4a4d-bd03-49b56e9990c4 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:25.893087 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-71af2db2-cdc3-4a4d-bd03-49b56e9990c4 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:25.893517 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-71af2db2-cdc3-4a4d-bd03-49b56e9990c4 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:25.932843 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=2 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:41:26.024689 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-71af2db2-cdc3-4a4d-bd03-49b56e9990c4 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c1ca0941b2455995640460a2027f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d656a5891ea40268b8be271b4cc7aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:41:26.033227 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-71af2db2-cdc3-4a4d-bd03-49b56e9990c4 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9" status: 200 len: 1260 microversion: 2.1 time: 0.154739 Aug 10 11:41:26.033810 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 408/817] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:41:25 2022] GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:41:26.886899 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-8d082289-c23c-4e5e-99c7-775519af78d4 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:26.887512 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-8d082289-c23c-4e5e-99c7-775519af78d4 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: e014e560-1308-466b-9b93-725098e79f2d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:26.894131 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8d082289-c23c-4e5e-99c7-775519af78d4 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:26.894616 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8d082289-c23c-4e5e-99c7-775519af78d4 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:26.895053 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8d082289-c23c-4e5e-99c7-775519af78d4 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:26.895746 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8d082289-c23c-4e5e-99c7-775519af78d4 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:26.896224 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8d082289-c23c-4e5e-99c7-775519af78d4 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:26.896651 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8d082289-c23c-4e5e-99c7-775519af78d4 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:27.032555 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-8d082289-c23c-4e5e-99c7-775519af78d4 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:41:27.040276 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-8d082289-c23c-4e5e-99c7-775519af78d4 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/e014e560-1308-466b-9b93-725098e79f2d" status: 200 len: 1266 microversion: 2.1 time: 0.157190 Aug 10 11:41:27.040867 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 410/818] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:41:26 2022] GET /compute/v2.1/servers/e014e560-1308-466b-9b93-725098e79f2d => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:41:27.055084 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-09d5c9d2-faf9-419b-887f-2accbb44a875 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:27.055697 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-09d5c9d2-faf9-419b-887f-2accbb44a875 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:27.062323 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-09d5c9d2-faf9-419b-887f-2accbb44a875 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:27.067887 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-09d5c9d2-faf9-419b-887f-2accbb44a875 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:27.067887 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-09d5c9d2-faf9-419b-887f-2accbb44a875 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:27.067887 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-09d5c9d2-faf9-419b-887f-2accbb44a875 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:27.067887 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-09d5c9d2-faf9-419b-887f-2accbb44a875 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:27.068293 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-09d5c9d2-faf9-419b-887f-2accbb44a875 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:27.200749 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-09d5c9d2-faf9-419b-887f-2accbb44a875 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c1ca0941b2455995640460a2027f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d656a5891ea40268b8be271b4cc7aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:41:27.208938 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-09d5c9d2-faf9-419b-887f-2accbb44a875 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9" status: 200 len: 1260 microversion: 2.1 time: 0.157675 Aug 10 11:41:27.209541 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 409/819] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:41:27 2022] GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:41:28.061822 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-4535b208-2027-4e68-a6db-16f1f5f40605 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:28.062406 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-4535b208-2027-4e68-a6db-16f1f5f40605 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: e014e560-1308-466b-9b93-725098e79f2d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:28.069159 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4535b208-2027-4e68-a6db-16f1f5f40605 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:28.069635 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4535b208-2027-4e68-a6db-16f1f5f40605 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:28.070066 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4535b208-2027-4e68-a6db-16f1f5f40605 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:28.070741 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4535b208-2027-4e68-a6db-16f1f5f40605 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:28.071188 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4535b208-2027-4e68-a6db-16f1f5f40605 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:28.071612 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4535b208-2027-4e68-a6db-16f1f5f40605 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:28.200907 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-4535b208-2027-4e68-a6db-16f1f5f40605 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:41:28.208955 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-4535b208-2027-4e68-a6db-16f1f5f40605 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/e014e560-1308-466b-9b93-725098e79f2d" status: 200 len: 1266 microversion: 2.1 time: 0.151054 Aug 10 11:41:28.209531 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 411/820] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:41:28 2022] GET /compute/v2.1/servers/e014e560-1308-466b-9b93-725098e79f2d => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:41:28.228848 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-f3c38d6c-382c-4338-8ad3-0c534890410b tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:28.229466 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-f3c38d6c-382c-4338-8ad3-0c534890410b tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:28.235843 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f3c38d6c-382c-4338-8ad3-0c534890410b tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:28.236368 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f3c38d6c-382c-4338-8ad3-0c534890410b tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:28.236805 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f3c38d6c-382c-4338-8ad3-0c534890410b tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:28.237491 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f3c38d6c-382c-4338-8ad3-0c534890410b tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:28.237945 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f3c38d6c-382c-4338-8ad3-0c534890410b tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:28.238373 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f3c38d6c-382c-4338-8ad3-0c534890410b tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:28.373347 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-f3c38d6c-382c-4338-8ad3-0c534890410b tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c1ca0941b2455995640460a2027f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d656a5891ea40268b8be271b4cc7aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:41:28.381251 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-f3c38d6c-382c-4338-8ad3-0c534890410b tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9" status: 200 len: 1260 microversion: 2.1 time: 0.156258 Aug 10 11:41:28.381813 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 410/821] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:41:28 2022] GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:41:29.076122 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-cf6c9a2c-5b17-4cb1-a99c-a0ab35429024 req-353a050a-edad-49d5-8613-e00347c1f54b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e014e560-1308-466b-9b93-725098e79f2d", "name": "network-vif-plugged", "status": "completed", "tag": "7f280e4b-4e93-4664-bfaf-0861417f39b6"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:41:29.086779 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-cf6c9a2c-5b17-4cb1-a99c-a0ab35429024 req-353a050a-edad-49d5-8613-e00347c1f54b service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:29.087262 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-cf6c9a2c-5b17-4cb1-a99c-a0ab35429024 req-353a050a-edad-49d5-8613-e00347c1f54b service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:29.087697 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-cf6c9a2c-5b17-4cb1-a99c-a0ab35429024 req-353a050a-edad-49d5-8613-e00347c1f54b service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:29.099274 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-cf6c9a2c-5b17-4cb1-a99c-a0ab35429024 req-353a050a-edad-49d5-8613-e00347c1f54b service nova] Creating event network-vif-plugged:7f280e4b-4e93-4664-bfaf-0861417f39b6 for instance e014e560-1308-466b-9b93-725098e79f2d on hv-cinder-85272 Aug 10 11:41:29.104234 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-cf6c9a2c-5b17-4cb1-a99c-a0ab35429024 req-353a050a-edad-49d5-8613-e00347c1f54b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031855 Aug 10 11:41:29.104813 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 412/822] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:41:29.236456 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-40b83bea-e7c6-4dfb-93ea-72ad14480340 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:29.237075 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-40b83bea-e7c6-4dfb-93ea-72ad14480340 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: e014e560-1308-466b-9b93-725098e79f2d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:29.243162 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-40b83bea-e7c6-4dfb-93ea-72ad14480340 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:29.243646 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-40b83bea-e7c6-4dfb-93ea-72ad14480340 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:29.244120 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-40b83bea-e7c6-4dfb-93ea-72ad14480340 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:29.250085 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-40b83bea-e7c6-4dfb-93ea-72ad14480340 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:29.250085 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-40b83bea-e7c6-4dfb-93ea-72ad14480340 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:29.250085 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-40b83bea-e7c6-4dfb-93ea-72ad14480340 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:29.395458 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-40b83bea-e7c6-4dfb-93ea-72ad14480340 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:41:29.403434 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-40b83bea-e7c6-4dfb-93ea-72ad14480340 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/e014e560-1308-466b-9b93-725098e79f2d" status: 200 len: 1266 microversion: 2.1 time: 0.170877 Aug 10 11:41:29.404017 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 411/823] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:41:29 2022] GET /compute/v2.1/servers/e014e560-1308-466b-9b93-725098e79f2d => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:41:29.404222 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-d7628ec9-86e0-4dd9-97d2-75f5a281d3ab tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:29.405175 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-d7628ec9-86e0-4dd9-97d2-75f5a281d3ab tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:29.413721 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d7628ec9-86e0-4dd9-97d2-75f5a281d3ab tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:29.414190 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d7628ec9-86e0-4dd9-97d2-75f5a281d3ab tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:29.414824 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d7628ec9-86e0-4dd9-97d2-75f5a281d3ab tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:29.415513 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d7628ec9-86e0-4dd9-97d2-75f5a281d3ab tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:29.415988 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d7628ec9-86e0-4dd9-97d2-75f5a281d3ab tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:29.416409 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d7628ec9-86e0-4dd9-97d2-75f5a281d3ab tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:29.589384 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-d7628ec9-86e0-4dd9-97d2-75f5a281d3ab tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c1ca0941b2455995640460a2027f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d656a5891ea40268b8be271b4cc7aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:41:29.597475 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-d7628ec9-86e0-4dd9-97d2-75f5a281d3ab tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9" status: 200 len: 1260 microversion: 2.1 time: 0.199413 Aug 10 11:41:29.598040 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 413/824] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:41:29 2022] GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9 => generated 1260 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:41:30.424524 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-3f75ffe6-93b1-4dfc-ac0f-05fb767611a7 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:30.425137 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-3f75ffe6-93b1-4dfc-ac0f-05fb767611a7 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: e014e560-1308-466b-9b93-725098e79f2d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:30.431606 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3f75ffe6-93b1-4dfc-ac0f-05fb767611a7 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:30.432124 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3f75ffe6-93b1-4dfc-ac0f-05fb767611a7 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:30.432565 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3f75ffe6-93b1-4dfc-ac0f-05fb767611a7 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:30.433253 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3f75ffe6-93b1-4dfc-ac0f-05fb767611a7 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:30.433709 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3f75ffe6-93b1-4dfc-ac0f-05fb767611a7 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:30.434134 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3f75ffe6-93b1-4dfc-ac0f-05fb767611a7 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:30.566697 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-3f75ffe6-93b1-4dfc-ac0f-05fb767611a7 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:41:30.574175 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-3f75ffe6-93b1-4dfc-ac0f-05fb767611a7 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/e014e560-1308-466b-9b93-725098e79f2d" status: 200 len: 1266 microversion: 2.1 time: 0.154001 Aug 10 11:41:30.574745 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 412/825] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:41:30 2022] GET /compute/v2.1/servers/e014e560-1308-466b-9b93-725098e79f2d => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:41:30.618823 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-d8379f2e-6830-42ce-8324-613321db7756 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:30.626406 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-d8379f2e-6830-42ce-8324-613321db7756 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:30.626406 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=4 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:41:30.627228 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d8379f2e-6830-42ce-8324-613321db7756 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:30.627716 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d8379f2e-6830-42ce-8324-613321db7756 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:30.628221 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d8379f2e-6830-42ce-8324-613321db7756 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:30.628950 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d8379f2e-6830-42ce-8324-613321db7756 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:30.629490 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d8379f2e-6830-42ce-8324-613321db7756 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:30.629937 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d8379f2e-6830-42ce-8324-613321db7756 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:30.771552 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-d8379f2e-6830-42ce-8324-613321db7756 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c1ca0941b2455995640460a2027f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d656a5891ea40268b8be271b4cc7aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:41:30.779159 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-d8379f2e-6830-42ce-8324-613321db7756 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9" status: 200 len: 1260 microversion: 2.1 time: 0.164664 Aug 10 11:41:30.779717 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 414/826] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:41:30 2022] GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:41:31.595516 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-6cbe7b01-3a86-440b-a8b2-810e7e63b32e tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:31.596185 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-6cbe7b01-3a86-440b-a8b2-810e7e63b32e tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: e014e560-1308-466b-9b93-725098e79f2d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:31.602533 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6cbe7b01-3a86-440b-a8b2-810e7e63b32e tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:31.603017 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6cbe7b01-3a86-440b-a8b2-810e7e63b32e tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:31.603453 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6cbe7b01-3a86-440b-a8b2-810e7e63b32e tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:31.604175 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6cbe7b01-3a86-440b-a8b2-810e7e63b32e tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:31.604630 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6cbe7b01-3a86-440b-a8b2-810e7e63b32e tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:31.605056 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6cbe7b01-3a86-440b-a8b2-810e7e63b32e tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:31.735721 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-6cbe7b01-3a86-440b-a8b2-810e7e63b32e tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:41:31.743267 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-6cbe7b01-3a86-440b-a8b2-810e7e63b32e tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/e014e560-1308-466b-9b93-725098e79f2d" status: 200 len: 1454 microversion: 2.1 time: 0.152016 Aug 10 11:41:31.743841 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 413/827] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:41:31 2022] GET /compute/v2.1/servers/e014e560-1308-466b-9b93-725098e79f2d => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:41:31.763916 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-befbc7f2-16ce-41b1-8b84-10433abc831f tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:31.764578 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-befbc7f2-16ce-41b1-8b84-10433abc831f tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: e014e560-1308-466b-9b93-725098e79f2d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:31.767508 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=14 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:41:31.772725 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-befbc7f2-16ce-41b1-8b84-10433abc831f tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:31.773240 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-befbc7f2-16ce-41b1-8b84-10433abc831f tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:31.775038 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-befbc7f2-16ce-41b1-8b84-10433abc831f tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:31.775038 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-befbc7f2-16ce-41b1-8b84-10433abc831f tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:31.775038 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-befbc7f2-16ce-41b1-8b84-10433abc831f tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:31.775318 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-befbc7f2-16ce-41b1-8b84-10433abc831f tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:31.799719 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-a1ddac71-9a40-4db8-a775-28d5a35f121d tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:31.800675 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-a1ddac71-9a40-4db8-a775-28d5a35f121d tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:31.806790 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a1ddac71-9a40-4db8-a775-28d5a35f121d tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:31.807273 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a1ddac71-9a40-4db8-a775-28d5a35f121d tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:31.807724 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a1ddac71-9a40-4db8-a775-28d5a35f121d tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:31.808448 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a1ddac71-9a40-4db8-a775-28d5a35f121d tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:31.808905 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a1ddac71-9a40-4db8-a775-28d5a35f121d tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:31.809402 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a1ddac71-9a40-4db8-a775-28d5a35f121d tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:31.909943 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-befbc7f2-16ce-41b1-8b84-10433abc831f tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:41:31.917692 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-befbc7f2-16ce-41b1-8b84-10433abc831f tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/e014e560-1308-466b-9b93-725098e79f2d" status: 200 len: 1454 microversion: 2.1 time: 0.157578 Aug 10 11:41:31.918265 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 415/828] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:41:31 2022] GET /compute/v2.1/servers/e014e560-1308-466b-9b93-725098e79f2d => generated 1454 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:41:31.949432 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-a1ddac71-9a40-4db8-a775-28d5a35f121d tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c1ca0941b2455995640460a2027f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d656a5891ea40268b8be271b4cc7aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:41:31.957506 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-a1ddac71-9a40-4db8-a775-28d5a35f121d tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9" status: 200 len: 1260 microversion: 2.1 time: 0.161600 Aug 10 11:41:31.958082 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 414/829] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:41:31 2022] GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:41:32.284665 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-5fb90cc8-4c5d-4fe0-82a9-8f48a927dcb6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:32.285262 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-5fb90cc8-4c5d-4fe0-82a9-8f48a927dcb6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: aa5d857b-b50d-4b03-aadb-a4072d4c1d3e] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:32.291226 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5fb90cc8-4c5d-4fe0-82a9-8f48a927dcb6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:32.291720 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5fb90cc8-4c5d-4fe0-82a9-8f48a927dcb6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:32.298210 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5fb90cc8-4c5d-4fe0-82a9-8f48a927dcb6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:32.298210 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5fb90cc8-4c5d-4fe0-82a9-8f48a927dcb6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:32.298210 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5fb90cc8-4c5d-4fe0-82a9-8f48a927dcb6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:32.298210 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5fb90cc8-4c5d-4fe0-82a9-8f48a927dcb6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:32.318844 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-5fb90cc8-4c5d-4fe0-82a9-8f48a927dcb6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/aa5d857b-b50d-4b03-aadb-a4072d4c1d3e/ips" status: 200 len: 150 microversion: 2.1 time: 0.038411 Aug 10 11:41:32.319428 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 416/830] 10.222.0.62 () {58 vars in 1248 bytes} [Wed Aug 10 11:41:32 2022] GET /compute/v2.1/servers/aa5d857b-b50d-4b03-aadb-a4072d4c1d3e/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:41:32.331850 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-79dc3719-fae5-4156-95d1-a87412b5d62d tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e440077-a562-4374-ba3a-c9e163e42e17"}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:41:32.334344 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-79dc3719-fae5-4156-95d1-a87412b5d62d tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: aa5d857b-b50d-4b03-aadb-a4072d4c1d3e] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:32.340766 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-79dc3719-fae5-4156-95d1-a87412b5d62d tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:32.341283 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-79dc3719-fae5-4156-95d1-a87412b5d62d tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:32.341725 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-79dc3719-fae5-4156-95d1-a87412b5d62d tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:32.342485 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-79dc3719-fae5-4156-95d1-a87412b5d62d tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:32.342942 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-79dc3719-fae5-4156-95d1-a87412b5d62d tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:32.343401 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-79dc3719-fae5-4156-95d1-a87412b5d62d tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:32.426393 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.wsgi [None req-79dc3719-fae5-4156-95d1-a87412b5d62d tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] HTTP exception thrown: Invalid volume: volume 4e440077-a562-4374-ba3a-c9e163e42e17 is already attached to instances: f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b Aug 10 11:41:32.428126 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-79dc3719-fae5-4156-95d1-a87412b5d62d tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Request method failure captured: Aug 10 11:41:32.428126 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: request: POST /compute/v2.1/servers/aa5d857b-b50d-4b03-aadb-a4072d4c1d3e/os-volume_attachments HTTP/1.1 Aug 10 11:41:32.428126 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Accept: application/json Aug 10 11:41:32.428126 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Aug 10 11:41:32.428126 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Connection: close Aug 10 11:41:32.428126 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Content-Length: 74 Aug 10 11:41:32.428126 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Content-Type: application/json Aug 10 11:41:32.428126 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Host: 10.222.0.62 Aug 10 11:41:32.428126 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Aug 10 11:41:32.428126 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.11 Aug 10 11:41:32.428126 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABi85j1Z_p4bHKfDtwCR5cI1vKkiUevZtLfKhR9gL2L4p6ZI7z3LVXhoVJRxMT9yim4mKqNT-79-8TxG-8rnVFFKy2oTj_gW51D7DVPA8mVxBXOeNjZ-pLCQGa21yrFE589EN2VLmuGuTme3GLbMFo9BJLvvm35OiLTdXNpruXqVvI3eZI Aug 10 11:41:32.428126 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Aug 10 11:41:32.428126 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Aug 10 11:41:32.428126 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Aug 10 11:41:32.428126 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Aug 10 11:41:32.428126 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Aug 10 11:41:32.428126 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Aug 10 11:41:32.428126 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Id: 1275e554301b4d019da34186581fc0da Aug 10 11:41:32.428126 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-AttachVolumeNegativeTest-1707340158 Aug 10 11:41:32.428126 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Role: member,reader Aug 10 11:41:32.428126 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Aug 10 11:41:32.436218 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1275e554301b4d019da34186581fc0da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1275e554301b4d019da34186581fc0da", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1275e554301b4d019da34186581fc0da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1275e554301b4d019da34186581fc0da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:41:32.436218 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-AttachVolumeNegativeTest-1707340158 Aug 10 11:41:32.436218 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant-Id: 1275e554301b4d019da34186581fc0da Aug 10 11:41:32.436218 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1707340158 Aug 10 11:41:32.436218 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User: tempest-AttachVolumeNegativeTest-1707340158-project Aug 10 11:41:32.436218 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Aug 10 11:41:32.436218 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Aug 10 11:41:32.436218 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Id: 4f61f9a578834243b0d11888c397deff Aug 10 11:41:32.436218 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-AttachVolumeNegativeTest-1707340158-project Aug 10 11:41:32.436218 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Aug 10 11:41:32.436218 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: {"volumeAttachment": {"volumeId": "4e440077-a562-4374-ba3a-c9e163e42e17"}} Aug 10 11:41:32.436218 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: method: > Aug 10 11:41:32.437226 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: exception: Invalid volume: volume 4e440077-a562-4374-ba3a-c9e163e42e17 is already attached to instances: f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b Aug 10 11:41:32.437226 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: action_args: {'server_id': 'aa5d857b-b50d-4b03-aadb-a4072d4c1d3e', 'body': {'volumeAttachment': {'volumeId': '4e440077-a562-4374-ba3a-c9e163e42e17'}}} Aug 10 11:41:32.437226 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:41:32.437226 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:41:32.437226 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 10 11:41:32.437226 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 10 11:41:32.437226 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 11:41:32.437226 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 11:41:32.437226 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 10 11:41:32.437226 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 10 11:41:32.437226 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 10 11:41:32.437226 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 10 11:41:32.437226 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 10 11:41:32.437226 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 10 11:41:32.437226 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4e440077-a562-4374-ba3a-c9e163e42e17 is already attached to instances: f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b Aug 10 11:41:32.437226 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:41:32.437226 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:41:32.437226 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:41:32.437226 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:41:32.439564 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:41:32.439564 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:41:32.439564 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:41:32.439564 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:41:32.439564 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:41:32.439564 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:41:32.439564 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 11:41:32.439564 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 11:41:32.439564 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 11:41:32.439564 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 11:41:32.439564 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 11:41:32.439564 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 11:41:32.439564 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 10 11:41:32.439564 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 10 11:41:32.439564 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4e440077-a562-4374-ba3a-c9e163e42e17 is already attached to instances: f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b Aug 10 11:41:32.439564 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:41:32.439564 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:41:32.439564 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:41:32.439564 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:41:32.439564 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:41:32.441151 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:41:32.441151 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:41:32.441151 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:41:32.441151 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4e440077-a562-4374-ba3a-c9e163e42e17 is already attached to instances: f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b Aug 10 11:41:32.441151 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:41:32.441151 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-79dc3719-fae5-4156-95d1-a87412b5d62d tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Returning 400 to user: Invalid volume: volume 4e440077-a562-4374-ba3a-c9e163e42e17 is already attached to instances: f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:41:32.441151 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-79dc3719-fae5-4156-95d1-a87412b5d62d tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "POST /compute/v2.1/servers/aa5d857b-b50d-4b03-aadb-a4072d4c1d3e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102799 Aug 10 11:41:32.441151 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 415/831] 10.222.0.62 () {60 vars in 1323 bytes} [Wed Aug 10 11:41:32 2022] POST /compute/v2.1/servers/aa5d857b-b50d-4b03-aadb-a4072d4c1d3e/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 10 11:41:32.441862 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-c5c28c1d-0e8e-4d59-9e7b-f8190e11788f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:32.441862 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-c5c28c1d-0e8e-4d59-9e7b-f8190e11788f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: aa5d857b-b50d-4b03-aadb-a4072d4c1d3e] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:32.445418 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c5c28c1d-0e8e-4d59-9e7b-f8190e11788f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:32.445919 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c5c28c1d-0e8e-4d59-9e7b-f8190e11788f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:32.446414 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c5c28c1d-0e8e-4d59-9e7b-f8190e11788f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:32.447091 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c5c28c1d-0e8e-4d59-9e7b-f8190e11788f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:32.447539 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c5c28c1d-0e8e-4d59-9e7b-f8190e11788f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:32.447991 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c5c28c1d-0e8e-4d59-9e7b-f8190e11788f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:32.473253 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-c5c28c1d-0e8e-4d59-9e7b-f8190e11788f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: aa5d857b-b50d-4b03-aadb-a4072d4c1d3e] Going to try to terminate instance {{(pid=124683) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:41:32.767676 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-c5c28c1d-0e8e-4d59-9e7b-f8190e11788f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "DELETE /compute/v2.1/servers/aa5d857b-b50d-4b03-aadb-a4072d4c1d3e" status: 204 len: 0 microversion: 2.1 time: 0.332944 Aug 10 11:41:32.768912 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 417/832] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 10 11:41:32 2022] DELETE /compute/v2.1/servers/aa5d857b-b50d-4b03-aadb-a4072d4c1d3e => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:41:32.777127 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-97d5eb8e-8a70-49a9-9b0e-7697294b700b tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:32.777969 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-97d5eb8e-8a70-49a9-9b0e-7697294b700b tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: aa5d857b-b50d-4b03-aadb-a4072d4c1d3e] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:32.785326 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-97d5eb8e-8a70-49a9-9b0e-7697294b700b tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:32.785838 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-97d5eb8e-8a70-49a9-9b0e-7697294b700b tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:32.786268 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-97d5eb8e-8a70-49a9-9b0e-7697294b700b tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:32.786954 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-97d5eb8e-8a70-49a9-9b0e-7697294b700b tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:32.787462 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-97d5eb8e-8a70-49a9-9b0e-7697294b700b tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:32.789688 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-97d5eb8e-8a70-49a9-9b0e-7697294b700b tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:32.922676 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-97d5eb8e-8a70-49a9-9b0e-7697294b700b tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:41:32.930429 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-97d5eb8e-8a70-49a9-9b0e-7697294b700b tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/aa5d857b-b50d-4b03-aadb-a4072d4c1d3e" status: 200 len: 1681 microversion: 2.1 time: 0.157114 Aug 10 11:41:32.931089 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 416/833] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:41:32 2022] GET /compute/v2.1/servers/aa5d857b-b50d-4b03-aadb-a4072d4c1d3e => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:41:32.979117 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-02380e16-2d2e-4c15-b508-afff13656eb1 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:32.979841 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-02380e16-2d2e-4c15-b508-afff13656eb1 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:32.986744 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-02380e16-2d2e-4c15-b508-afff13656eb1 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:32.987221 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-02380e16-2d2e-4c15-b508-afff13656eb1 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:32.987651 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-02380e16-2d2e-4c15-b508-afff13656eb1 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:32.988358 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-02380e16-2d2e-4c15-b508-afff13656eb1 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:32.988805 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-02380e16-2d2e-4c15-b508-afff13656eb1 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:32.989226 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-02380e16-2d2e-4c15-b508-afff13656eb1 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:32.993196 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:41:33.343292 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-02380e16-2d2e-4c15-b508-afff13656eb1 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c1ca0941b2455995640460a2027f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d656a5891ea40268b8be271b4cc7aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:41:33.353482 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-02380e16-2d2e-4c15-b508-afff13656eb1 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9" status: 200 len: 1260 microversion: 2.1 time: 0.378455 Aug 10 11:41:33.366122 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 418/834] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:41:32 2022] GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9 => generated 1260 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:41:33.885847 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-f405d7da-4abc-47a2-8788-2c9d3207ec77 req-9f004812-a03d-431e-a9b3-dbec76b4e351 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e014e560-1308-466b-9b93-725098e79f2d", "tag": "7f280e4b-4e93-4664-bfaf-0861417f39b6"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:41:33.896311 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-f405d7da-4abc-47a2-8788-2c9d3207ec77 req-9f004812-a03d-431e-a9b3-dbec76b4e351 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:33.896886 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-f405d7da-4abc-47a2-8788-2c9d3207ec77 req-9f004812-a03d-431e-a9b3-dbec76b4e351 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:33.897385 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-f405d7da-4abc-47a2-8788-2c9d3207ec77 req-9f004812-a03d-431e-a9b3-dbec76b4e351 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:33.909487 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-f405d7da-4abc-47a2-8788-2c9d3207ec77 req-9f004812-a03d-431e-a9b3-dbec76b4e351 service nova] Creating event network-changed:7f280e4b-4e93-4664-bfaf-0861417f39b6 for instance e014e560-1308-466b-9b93-725098e79f2d on hv-cinder-85272 Aug 10 11:41:33.914624 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-f405d7da-4abc-47a2-8788-2c9d3207ec77 req-9f004812-a03d-431e-a9b3-dbec76b4e351 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032578 Aug 10 11:41:33.915306 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 417/835] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:41:33.953044 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-6fa4a0fa-2e5d-4c39-bcf7-1287a12646ae tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:33.953733 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-6fa4a0fa-2e5d-4c39-bcf7-1287a12646ae tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: aa5d857b-b50d-4b03-aadb-a4072d4c1d3e] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:33.959550 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6fa4a0fa-2e5d-4c39-bcf7-1287a12646ae tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:33.960058 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6fa4a0fa-2e5d-4c39-bcf7-1287a12646ae tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:33.960497 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6fa4a0fa-2e5d-4c39-bcf7-1287a12646ae tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:33.961181 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6fa4a0fa-2e5d-4c39-bcf7-1287a12646ae tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:33.961624 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6fa4a0fa-2e5d-4c39-bcf7-1287a12646ae tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:33.962040 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6fa4a0fa-2e5d-4c39-bcf7-1287a12646ae tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:34.139660 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-6fa4a0fa-2e5d-4c39-bcf7-1287a12646ae tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:41:34.148060 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-6fa4a0fa-2e5d-4c39-bcf7-1287a12646ae tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/aa5d857b-b50d-4b03-aadb-a4072d4c1d3e" status: 200 len: 1681 microversion: 2.1 time: 0.198964 Aug 10 11:41:34.148686 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 419/836] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:41:33 2022] GET /compute/v2.1/servers/aa5d857b-b50d-4b03-aadb-a4072d4c1d3e => generated 1681 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:41:34.374092 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-e9f14286-7abe-4aca-880a-e2666f230bfb tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:34.375113 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-e9f14286-7abe-4aca-880a-e2666f230bfb tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:34.382544 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e9f14286-7abe-4aca-880a-e2666f230bfb tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:34.383031 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e9f14286-7abe-4aca-880a-e2666f230bfb tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:34.383468 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e9f14286-7abe-4aca-880a-e2666f230bfb tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:34.384197 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e9f14286-7abe-4aca-880a-e2666f230bfb tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:34.384655 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e9f14286-7abe-4aca-880a-e2666f230bfb tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:34.385073 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e9f14286-7abe-4aca-880a-e2666f230bfb tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:34.406696 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=100 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:41:34.546014 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-e9f14286-7abe-4aca-880a-e2666f230bfb tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c1ca0941b2455995640460a2027f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d656a5891ea40268b8be271b4cc7aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:41:34.554468 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-e9f14286-7abe-4aca-880a-e2666f230bfb tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9" status: 200 len: 1260 microversion: 2.1 time: 0.184456 Aug 10 11:41:34.569084 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 418/837] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:41:34 2022] GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9 => generated 1260 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:41:35.169079 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-2eab2b2f-9438-435a-bbba-c24c0eb1df2f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:35.169702 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-2eab2b2f-9438-435a-bbba-c24c0eb1df2f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: aa5d857b-b50d-4b03-aadb-a4072d4c1d3e] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:35.177179 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2eab2b2f-9438-435a-bbba-c24c0eb1df2f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:35.177692 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2eab2b2f-9438-435a-bbba-c24c0eb1df2f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:35.178134 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2eab2b2f-9438-435a-bbba-c24c0eb1df2f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:35.178861 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2eab2b2f-9438-435a-bbba-c24c0eb1df2f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:35.179311 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2eab2b2f-9438-435a-bbba-c24c0eb1df2f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:35.179754 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2eab2b2f-9438-435a-bbba-c24c0eb1df2f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:35.325928 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-2eab2b2f-9438-435a-bbba-c24c0eb1df2f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:41:35.333722 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-2eab2b2f-9438-435a-bbba-c24c0eb1df2f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/aa5d857b-b50d-4b03-aadb-a4072d4c1d3e" status: 200 len: 1681 microversion: 2.1 time: 0.168622 Aug 10 11:41:35.334287 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 420/838] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:41:35 2022] GET /compute/v2.1/servers/aa5d857b-b50d-4b03-aadb-a4072d4c1d3e => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:41:35.567986 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-3c5d5128-e0de-4635-94c0-d05556f920b7 req-2bbc6134-609f-414c-aed3-3a25998ebeea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa5d857b-b50d-4b03-aadb-a4072d4c1d3e", "name": "network-vif-deleted", "tag": "a7423053-2221-4807-ad6d-4a56639d7625"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:41:35.576064 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-4fa0c677-93f6-4c3b-956e-bee12a5322f1 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:35.576938 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-4fa0c677-93f6-4c3b-956e-bee12a5322f1 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:35.580177 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-3c5d5128-e0de-4635-94c0-d05556f920b7 req-2bbc6134-609f-414c-aed3-3a25998ebeea service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:35.580177 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-3c5d5128-e0de-4635-94c0-d05556f920b7 req-2bbc6134-609f-414c-aed3-3a25998ebeea service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:35.580676 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-3c5d5128-e0de-4635-94c0-d05556f920b7 req-2bbc6134-609f-414c-aed3-3a25998ebeea service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:35.583989 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4fa0c677-93f6-4c3b-956e-bee12a5322f1 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:35.584527 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4fa0c677-93f6-4c3b-956e-bee12a5322f1 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:35.584943 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4fa0c677-93f6-4c3b-956e-bee12a5322f1 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:35.585658 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4fa0c677-93f6-4c3b-956e-bee12a5322f1 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:35.586118 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4fa0c677-93f6-4c3b-956e-bee12a5322f1 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:35.586549 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4fa0c677-93f6-4c3b-956e-bee12a5322f1 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:35.593618 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-3c5d5128-e0de-4635-94c0-d05556f920b7 req-2bbc6134-609f-414c-aed3-3a25998ebeea service nova] Creating event network-vif-deleted:a7423053-2221-4807-ad6d-4a56639d7625 for instance aa5d857b-b50d-4b03-aadb-a4072d4c1d3e on hv-cinder-85272 Aug 10 11:41:35.601541 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-3c5d5128-e0de-4635-94c0-d05556f920b7 req-2bbc6134-609f-414c-aed3-3a25998ebeea service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036553 Aug 10 11:41:35.602924 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 419/839] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:41:35.740070 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-4fa0c677-93f6-4c3b-956e-bee12a5322f1 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c1ca0941b2455995640460a2027f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d656a5891ea40268b8be271b4cc7aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:41:35.750326 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-4fa0c677-93f6-4c3b-956e-bee12a5322f1 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9" status: 200 len: 1260 microversion: 2.1 time: 0.178091 Aug 10 11:41:35.751314 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 421/840] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:41:35 2022] GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9 => generated 1260 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:41:36.355826 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-848cd1bf-9362-4e42-9a8c-26c5552d35cd tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:36.356614 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-848cd1bf-9362-4e42-9a8c-26c5552d35cd tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: aa5d857b-b50d-4b03-aadb-a4072d4c1d3e] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:36.363045 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-848cd1bf-9362-4e42-9a8c-26c5552d35cd tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:36.363591 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-848cd1bf-9362-4e42-9a8c-26c5552d35cd tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:36.364066 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-848cd1bf-9362-4e42-9a8c-26c5552d35cd tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:36.364767 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-848cd1bf-9362-4e42-9a8c-26c5552d35cd tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:36.365229 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-848cd1bf-9362-4e42-9a8c-26c5552d35cd tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:36.365658 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-848cd1bf-9362-4e42-9a8c-26c5552d35cd tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:36.403871 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-848cd1bf-9362-4e42-9a8c-26c5552d35cd tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:36.404312 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-848cd1bf-9362-4e42-9a8c-26c5552d35cd tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:36.404746 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-848cd1bf-9362-4e42-9a8c-26c5552d35cd tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:36.405196 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.objects.instance [None req-848cd1bf-9362-4e42-9a8c-26c5552d35cd tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lazy-loading 'fault' on Instance uuid aa5d857b-b50d-4b03-aadb-a4072d4c1d3e {{(pid=124682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:41:36.453126 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-848cd1bf-9362-4e42-9a8c-26c5552d35cd tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:41:36.461575 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-848cd1bf-9362-4e42-9a8c-26c5552d35cd tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/aa5d857b-b50d-4b03-aadb-a4072d4c1d3e" status: 200 len: 1331 microversion: 2.1 time: 0.109890 Aug 10 11:41:36.462152 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 420/841] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:41:36 2022] GET /compute/v2.1/servers/aa5d857b-b50d-4b03-aadb-a4072d4c1d3e => generated 1331 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:41:36.772083 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-2ac644fc-d6e1-4ee0-b1d4-22c18b07a687 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:36.773709 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-2ac644fc-d6e1-4ee0-b1d4-22c18b07a687 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:36.779291 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2ac644fc-d6e1-4ee0-b1d4-22c18b07a687 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:36.779778 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2ac644fc-d6e1-4ee0-b1d4-22c18b07a687 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:36.780319 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2ac644fc-d6e1-4ee0-b1d4-22c18b07a687 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:36.781036 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2ac644fc-d6e1-4ee0-b1d4-22c18b07a687 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:36.781549 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2ac644fc-d6e1-4ee0-b1d4-22c18b07a687 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:36.782173 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2ac644fc-d6e1-4ee0-b1d4-22c18b07a687 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:36.915445 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-2ac644fc-d6e1-4ee0-b1d4-22c18b07a687 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c1ca0941b2455995640460a2027f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d656a5891ea40268b8be271b4cc7aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:41:36.923143 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-2ac644fc-d6e1-4ee0-b1d4-22c18b07a687 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9" status: 200 len: 1260 microversion: 2.1 time: 0.154953 Aug 10 11:41:36.923710 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 422/842] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:41:36 2022] GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:41:37.105636 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-581c2fd2-51a9-4f8f-97a4-59d81cecc2d9 req-43c12043-3b19-4782-b325-a7cc1ef59cb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dd20638-cdb6-4db7-a23e-c98c00e103d9", "name": "network-vif-plugged", "status": "completed", "tag": "2743679b-eeea-46d5-a860-adc80ef124b6"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:41:37.116275 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-581c2fd2-51a9-4f8f-97a4-59d81cecc2d9 req-43c12043-3b19-4782-b325-a7cc1ef59cb5 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:37.116756 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-581c2fd2-51a9-4f8f-97a4-59d81cecc2d9 req-43c12043-3b19-4782-b325-a7cc1ef59cb5 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:37.117254 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-581c2fd2-51a9-4f8f-97a4-59d81cecc2d9 req-43c12043-3b19-4782-b325-a7cc1ef59cb5 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:37.128511 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-581c2fd2-51a9-4f8f-97a4-59d81cecc2d9 req-43c12043-3b19-4782-b325-a7cc1ef59cb5 service nova] Creating event network-vif-plugged:2743679b-eeea-46d5-a860-adc80ef124b6 for instance 2dd20638-cdb6-4db7-a23e-c98c00e103d9 on hv-cinder-85272 Aug 10 11:41:37.133233 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-581c2fd2-51a9-4f8f-97a4-59d81cecc2d9 req-43c12043-3b19-4782-b325-a7cc1ef59cb5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031238 Aug 10 11:41:37.133813 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 421/843] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:41:37.484261 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-a06e9db0-1fdb-488b-b13d-858cb6aa22ac tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:37.484901 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-a06e9db0-1fdb-488b-b13d-858cb6aa22ac tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: aa5d857b-b50d-4b03-aadb-a4072d4c1d3e] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:37.491534 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a06e9db0-1fdb-488b-b13d-858cb6aa22ac tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:37.492102 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a06e9db0-1fdb-488b-b13d-858cb6aa22ac tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:37.492546 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a06e9db0-1fdb-488b-b13d-858cb6aa22ac tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:37.493251 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a06e9db0-1fdb-488b-b13d-858cb6aa22ac tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:37.493776 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a06e9db0-1fdb-488b-b13d-858cb6aa22ac tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:37.494183 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a06e9db0-1fdb-488b-b13d-858cb6aa22ac tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:37.510889 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-a06e9db0-1fdb-488b-b13d-858cb6aa22ac tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] HTTP exception thrown: Instance aa5d857b-b50d-4b03-aadb-a4072d4c1d3e could not be found. Aug 10 11:41:37.511546 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-a06e9db0-1fdb-488b-b13d-858cb6aa22ac tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Request method failure captured: Aug 10 11:41:37.511546 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: request: GET /compute/v2.1/servers/aa5d857b-b50d-4b03-aadb-a4072d4c1d3e HTTP/1.1 Aug 10 11:41:37.511546 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept: application/json Aug 10 11:41:37.511546 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Aug 10 11:41:37.511546 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Connection: close Aug 10 11:41:37.511546 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Length: 0 Aug 10 11:41:37.511546 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Type: application/json Aug 10 11:41:37.511546 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Host: 10.222.0.62 Aug 10 11:41:37.511546 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Aug 10 11:41:37.511546 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.11 Aug 10 11:41:37.511546 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABi85j1Z_p4bHKfDtwCR5cI1vKkiUevZtLfKhR9gL2L4p6ZI7z3LVXhoVJRxMT9yim4mKqNT-79-8TxG-8rnVFFKy2oTj_gW51D7DVPA8mVxBXOeNjZ-pLCQGa21yrFE589EN2VLmuGuTme3GLbMFo9BJLvvm35OiLTdXNpruXqVvI3eZI Aug 10 11:41:37.511546 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Aug 10 11:41:37.511546 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Aug 10 11:41:37.511546 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Aug 10 11:41:37.511546 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Aug 10 11:41:37.511546 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Aug 10 11:41:37.511546 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Aug 10 11:41:37.511546 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Id: 1275e554301b4d019da34186581fc0da Aug 10 11:41:37.511546 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-AttachVolumeNegativeTest-1707340158 Aug 10 11:41:37.511546 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Role: member,reader Aug 10 11:41:37.511546 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Aug 10 11:41:37.517158 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1275e554301b4d019da34186581fc0da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1275e554301b4d019da34186581fc0da", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1275e554301b4d019da34186581fc0da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1275e554301b4d019da34186581fc0da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:41:37.517158 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-AttachVolumeNegativeTest-1707340158 Aug 10 11:41:37.517158 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Id: 1275e554301b4d019da34186581fc0da Aug 10 11:41:37.517158 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1707340158 Aug 10 11:41:37.517158 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User: tempest-AttachVolumeNegativeTest-1707340158-project Aug 10 11:41:37.517158 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Aug 10 11:41:37.517158 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Aug 10 11:41:37.517158 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Id: 4f61f9a578834243b0d11888c397deff Aug 10 11:41:37.517158 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-AttachVolumeNegativeTest-1707340158-project Aug 10 11:41:37.517158 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: method: > Aug 10 11:41:37.517158 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: exception: Instance aa5d857b-b50d-4b03-aadb-a4072d4c1d3e could not be found. Aug 10 11:41:37.517158 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: action_args: {'id': 'aa5d857b-b50d-4b03-aadb-a4072d4c1d3e'} Aug 10 11:41:37.519272 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:41:37.519272 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:41:37.519272 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:41:37.519272 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:41:37.519272 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:41:37.519272 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:41:37.519272 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:41:37.519272 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:41:37.519272 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:41:37.519272 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:41:37.519272 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa5d857b-b50d-4b03-aadb-a4072d4c1d3e could not be found. Aug 10 11:41:37.519272 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:41:37.519272 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:41:37.519272 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:41:37.519272 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:41:37.519272 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:41:37.519272 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:41:37.519272 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:41:37.519272 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:41:37.519272 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:41:37.522211 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:41:37.522211 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:41:37.522211 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:41:37.522211 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:41:37.522211 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:41:37.522211 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:41:37.522211 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:41:37.522211 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa5d857b-b50d-4b03-aadb-a4072d4c1d3e could not be found. Aug 10 11:41:37.522211 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:41:37.522211 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:41:37.522211 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:41:37.522211 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:41:37.522211 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:41:37.522211 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:41:37.522211 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:41:37.522211 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:41:37.522211 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa5d857b-b50d-4b03-aadb-a4072d4c1d3e could not be found. Aug 10 11:41:37.522211 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:41:37.524863 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-a06e9db0-1fdb-488b-b13d-858cb6aa22ac tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Returning 404 to user: Instance aa5d857b-b50d-4b03-aadb-a4072d4c1d3e could not be found. {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:41:37.524863 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-a06e9db0-1fdb-488b-b13d-858cb6aa22ac tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/aa5d857b-b50d-4b03-aadb-a4072d4c1d3e" status: 404 len: 111 microversion: 2.1 time: 0.033424 Aug 10 11:41:37.524863 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 423/844] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:41:37 2022] GET /compute/v2.1/servers/aa5d857b-b50d-4b03-aadb-a4072d4c1d3e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:41:37.525717 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-75b2cf25-c355-4e7b-93b6-6b3876fd1056 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '.version_select at 0x7fb7cdc47280>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:37.665469 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-75b2cf25-c355-4e7b-93b6-6b3876fd1056 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-369358502" status: 202 len: 0 microversion: 2.1 time: 0.145742 Aug 10 11:41:37.666084 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 422/845] 10.222.0.62 () {58 vars in 1218 bytes} [Wed Aug 10 11:41:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-369358502 => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 11:41:37.943622 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f1035788-6e10-422a-bcb4-81b7e68c7939 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:37.944357 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-f1035788-6e10-422a-bcb4-81b7e68c7939 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:37.950881 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f1035788-6e10-422a-bcb4-81b7e68c7939 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:37.951441 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f1035788-6e10-422a-bcb4-81b7e68c7939 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:37.951981 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f1035788-6e10-422a-bcb4-81b7e68c7939 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:37.952757 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f1035788-6e10-422a-bcb4-81b7e68c7939 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:37.953445 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f1035788-6e10-422a-bcb4-81b7e68c7939 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:37.953940 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f1035788-6e10-422a-bcb4-81b7e68c7939 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:38.170412 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-f1035788-6e10-422a-bcb4-81b7e68c7939 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c1ca0941b2455995640460a2027f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d656a5891ea40268b8be271b4cc7aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:41:38.178948 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-f1035788-6e10-422a-bcb4-81b7e68c7939 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9" status: 200 len: 1260 microversion: 2.1 time: 0.239286 Aug 10 11:41:38.179516 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 424/846] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:41:37 2022] GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9 => generated 1260 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:41:38.529495 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-0091f471-b89d-41c6-b1db-9e0783061e0e tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:38.530105 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-0091f471-b89d-41c6-b1db-9e0783061e0e tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:38.536718 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0091f471-b89d-41c6-b1db-9e0783061e0e tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:38.537194 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0091f471-b89d-41c6-b1db-9e0783061e0e tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:38.537627 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0091f471-b89d-41c6-b1db-9e0783061e0e tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:38.538305 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0091f471-b89d-41c6-b1db-9e0783061e0e tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:38.538758 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0091f471-b89d-41c6-b1db-9e0783061e0e tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:38.539184 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0091f471-b89d-41c6-b1db-9e0783061e0e tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:38.620950 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.objects.instance [None req-0091f471-b89d-41c6-b1db-9e0783061e0e tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lazy-loading 'services' on Instance uuid f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b {{(pid=124682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:41:38.898187 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-0091f471-b89d-41c6-b1db-9e0783061e0e tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "DELETE /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b/os-volume_attachments/4e440077-a562-4374-ba3a-c9e163e42e17" status: 202 len: 0 microversion: 2.1 time: 0.372797 Aug 10 11:41:38.899076 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 423/847] 10.222.0.62 () {58 vars in 1416 bytes} [Wed Aug 10 11:41:38 2022] DELETE /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b/os-volume_attachments/4e440077-a562-4374-ba3a-c9e163e42e17 => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:41:38.907843 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-2cdcf76e-4805-475b-ad85-a5078385af99 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:38.910099 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-2cdcf76e-4805-475b-ad85-a5078385af99 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:38.916121 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2cdcf76e-4805-475b-ad85-a5078385af99 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:38.916491 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2cdcf76e-4805-475b-ad85-a5078385af99 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:38.916950 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2cdcf76e-4805-475b-ad85-a5078385af99 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:38.917643 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2cdcf76e-4805-475b-ad85-a5078385af99 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:38.918280 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2cdcf76e-4805-475b-ad85-a5078385af99 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:38.918778 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2cdcf76e-4805-475b-ad85-a5078385af99 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:38.957930 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-2cdcf76e-4805-475b-ad85-a5078385af99 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054727 Aug 10 11:41:38.958637 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 425/848] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 10 11:41:38 2022] GET /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:41:39.200597 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-daa8aa91-98e3-4aca-a5ea-b4b57d9abb38 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:39.201293 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-daa8aa91-98e3-4aca-a5ea-b4b57d9abb38 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:39.207528 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-daa8aa91-98e3-4aca-a5ea-b4b57d9abb38 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:39.208034 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-daa8aa91-98e3-4aca-a5ea-b4b57d9abb38 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:39.208467 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-daa8aa91-98e3-4aca-a5ea-b4b57d9abb38 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:39.209142 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-daa8aa91-98e3-4aca-a5ea-b4b57d9abb38 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:39.209594 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-daa8aa91-98e3-4aca-a5ea-b4b57d9abb38 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:39.210010 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-daa8aa91-98e3-4aca-a5ea-b4b57d9abb38 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:39.347785 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-daa8aa91-98e3-4aca-a5ea-b4b57d9abb38 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c1ca0941b2455995640460a2027f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d656a5891ea40268b8be271b4cc7aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:41:39.355171 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-daa8aa91-98e3-4aca-a5ea-b4b57d9abb38 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9" status: 200 len: 1445 microversion: 2.1 time: 0.158785 Aug 10 11:41:39.355725 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 424/849] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:41:39 2022] GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9 => generated 1445 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:41:39.375332 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-1bf1a454-6504-4b3d-8859-06c760cd97b3 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:39.376001 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-1bf1a454-6504-4b3d-8859-06c760cd97b3 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:39.382088 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1bf1a454-6504-4b3d-8859-06c760cd97b3 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:39.382565 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1bf1a454-6504-4b3d-8859-06c760cd97b3 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:39.382994 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1bf1a454-6504-4b3d-8859-06c760cd97b3 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:39.383672 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1bf1a454-6504-4b3d-8859-06c760cd97b3 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:39.384149 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1bf1a454-6504-4b3d-8859-06c760cd97b3 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:39.384570 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1bf1a454-6504-4b3d-8859-06c760cd97b3 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:39.522216 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-1bf1a454-6504-4b3d-8859-06c760cd97b3 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c1ca0941b2455995640460a2027f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d656a5891ea40268b8be271b4cc7aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:41:39.529670 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-1bf1a454-6504-4b3d-8859-06c760cd97b3 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9" status: 200 len: 1445 microversion: 2.1 time: 0.158585 Aug 10 11:41:39.530220 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 426/850] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:41:39 2022] GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9 => generated 1445 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:41:39.971294 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-33e05af2-205a-4834-b255-0b1d27069b23 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:39.973558 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-33e05af2-205a-4834-b255-0b1d27069b23 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:39.979872 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-33e05af2-205a-4834-b255-0b1d27069b23 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:39.980388 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-33e05af2-205a-4834-b255-0b1d27069b23 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:39.980817 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-33e05af2-205a-4834-b255-0b1d27069b23 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:39.981515 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-33e05af2-205a-4834-b255-0b1d27069b23 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:39.981966 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-33e05af2-205a-4834-b255-0b1d27069b23 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:39.982390 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-33e05af2-205a-4834-b255-0b1d27069b23 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:40.011756 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-33e05af2-205a-4834-b255-0b1d27069b23 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045117 Aug 10 11:41:40.012370 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 425/851] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 10 11:41:39 2022] GET /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 11:41:40.084610 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-bc8c7dba-f485-4109-b1d9-d2bc13e4f9d6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:40.085183 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-bc8c7dba-f485-4109-b1d9-d2bc13e4f9d6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:40.091417 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bc8c7dba-f485-4109-b1d9-d2bc13e4f9d6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:40.100324 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bc8c7dba-f485-4109-b1d9-d2bc13e4f9d6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:40.100324 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bc8c7dba-f485-4109-b1d9-d2bc13e4f9d6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:40.100324 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bc8c7dba-f485-4109-b1d9-d2bc13e4f9d6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:40.100324 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bc8c7dba-f485-4109-b1d9-d2bc13e4f9d6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:40.100759 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bc8c7dba-f485-4109-b1d9-d2bc13e4f9d6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:40.121190 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-bc8c7dba-f485-4109-b1d9-d2bc13e4f9d6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b] Going to try to terminate instance {{(pid=124683) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:41:40.381629 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:41:40.458852 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-bc8c7dba-f485-4109-b1d9-d2bc13e4f9d6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "DELETE /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b" status: 204 len: 0 microversion: 2.1 time: 0.377814 Aug 10 11:41:40.459495 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 427/852] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 10 11:41:40 2022] DELETE /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:41:40.467592 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-df3585f4-183a-4b2b-9087-d68cbb323b26 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:40.468224 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-df3585f4-183a-4b2b-9087-d68cbb323b26 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:40.474656 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-df3585f4-183a-4b2b-9087-d68cbb323b26 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:40.475307 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-df3585f4-183a-4b2b-9087-d68cbb323b26 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:40.475754 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-df3585f4-183a-4b2b-9087-d68cbb323b26 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:40.476495 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-df3585f4-183a-4b2b-9087-d68cbb323b26 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:40.476959 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-df3585f4-183a-4b2b-9087-d68cbb323b26 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:40.477544 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-df3585f4-183a-4b2b-9087-d68cbb323b26 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:40.668855 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-df3585f4-183a-4b2b-9087-d68cbb323b26 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:41:40.676638 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-df3585f4-183a-4b2b-9087-d68cbb323b26 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b" status: 200 len: 1682 microversion: 2.1 time: 0.212871 Aug 10 11:41:40.677215 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 426/853] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:41:40 2022] GET /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b => generated 1682 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:41:41.699171 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-e2087d51-b3ca-415a-8bd1-e48125a6ac4c tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:41.700679 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-e2087d51-b3ca-415a-8bd1-e48125a6ac4c tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:41.708257 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e2087d51-b3ca-415a-8bd1-e48125a6ac4c tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:41.709016 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e2087d51-b3ca-415a-8bd1-e48125a6ac4c tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:41.709455 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e2087d51-b3ca-415a-8bd1-e48125a6ac4c tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:41.710158 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e2087d51-b3ca-415a-8bd1-e48125a6ac4c tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:41.710650 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e2087d51-b3ca-415a-8bd1-e48125a6ac4c tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:41.711197 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e2087d51-b3ca-415a-8bd1-e48125a6ac4c tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:41.782350 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-cfabb1a6-ba4f-4178-bd20-1dbbc2dcdc19 req-5516aed9-356a-4fc6-afe1-f561c4d62ec2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dd20638-cdb6-4db7-a23e-c98c00e103d9", "tag": "2743679b-eeea-46d5-a860-adc80ef124b6"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:41:41.792663 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-cfabb1a6-ba4f-4178-bd20-1dbbc2dcdc19 req-5516aed9-356a-4fc6-afe1-f561c4d62ec2 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:41.793232 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-cfabb1a6-ba4f-4178-bd20-1dbbc2dcdc19 req-5516aed9-356a-4fc6-afe1-f561c4d62ec2 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:41.800240 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-cfabb1a6-ba4f-4178-bd20-1dbbc2dcdc19 req-5516aed9-356a-4fc6-afe1-f561c4d62ec2 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:41.806640 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-cfabb1a6-ba4f-4178-bd20-1dbbc2dcdc19 req-5516aed9-356a-4fc6-afe1-f561c4d62ec2 service nova] Creating event network-changed:2743679b-eeea-46d5-a860-adc80ef124b6 for instance 2dd20638-cdb6-4db7-a23e-c98c00e103d9 on hv-cinder-85272 Aug 10 11:41:41.811586 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-cfabb1a6-ba4f-4178-bd20-1dbbc2dcdc19 req-5516aed9-356a-4fc6-afe1-f561c4d62ec2 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032971 Aug 10 11:41:41.812241 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 427/854] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:41:41.866582 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-e2087d51-b3ca-415a-8bd1-e48125a6ac4c tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:41:41.876446 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-e2087d51-b3ca-415a-8bd1-e48125a6ac4c tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b" status: 200 len: 1682 microversion: 2.1 time: 0.181584 Aug 10 11:41:41.877339 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 428/855] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:41:41 2022] GET /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b => generated 1682 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:41:42.898541 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-d496f03a-38b0-4e89-822e-de05c4b92107 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:42.899375 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-d496f03a-38b0-4e89-822e-de05c4b92107 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:42.905668 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d496f03a-38b0-4e89-822e-de05c4b92107 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:42.906166 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d496f03a-38b0-4e89-822e-de05c4b92107 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:42.906610 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d496f03a-38b0-4e89-822e-de05c4b92107 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:42.907299 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d496f03a-38b0-4e89-822e-de05c4b92107 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:42.907751 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d496f03a-38b0-4e89-822e-de05c4b92107 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:42.908200 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d496f03a-38b0-4e89-822e-de05c4b92107 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:42.969445 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-d496f03a-38b0-4e89-822e-de05c4b92107 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:41:42.977250 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-d496f03a-38b0-4e89-822e-de05c4b92107 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b" status: 200 len: 1614 microversion: 2.1 time: 0.083383 Aug 10 11:41:42.977834 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 428/856] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:41:42 2022] GET /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b => generated 1614 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:41:43.094362 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-e826a648-265c-4ddf-b537-b09459910f3c req-1fc0ddff-8871-4d3c-b9ff-713b8202af38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b", "name": "network-vif-deleted", "tag": "106fb866-bca9-40a9-b61a-90991f6179ed"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:41:43.103818 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-e826a648-265c-4ddf-b537-b09459910f3c req-1fc0ddff-8871-4d3c-b9ff-713b8202af38 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:43.104354 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-e826a648-265c-4ddf-b537-b09459910f3c req-1fc0ddff-8871-4d3c-b9ff-713b8202af38 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:43.104759 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-e826a648-265c-4ddf-b537-b09459910f3c req-1fc0ddff-8871-4d3c-b9ff-713b8202af38 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:43.115992 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-e826a648-265c-4ddf-b537-b09459910f3c req-1fc0ddff-8871-4d3c-b9ff-713b8202af38 service nova] Creating event network-vif-deleted:106fb866-bca9-40a9-b61a-90991f6179ed for instance f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b on hv-cinder-85272 Aug 10 11:41:43.120823 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-e826a648-265c-4ddf-b537-b09459910f3c req-1fc0ddff-8871-4d3c-b9ff-713b8202af38 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030217 Aug 10 11:41:43.121629 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 429/857] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:41:43.999156 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-7c5b317e-bd08-4fae-856e-7fb948219ac0 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:43.999865 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-7c5b317e-bd08-4fae-856e-7fb948219ac0 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:44.006710 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7c5b317e-bd08-4fae-856e-7fb948219ac0 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:44.008516 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7c5b317e-bd08-4fae-856e-7fb948219ac0 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:44.008971 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7c5b317e-bd08-4fae-856e-7fb948219ac0 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:44.009695 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7c5b317e-bd08-4fae-856e-7fb948219ac0 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:44.010158 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7c5b317e-bd08-4fae-856e-7fb948219ac0 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:44.010588 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7c5b317e-bd08-4fae-856e-7fb948219ac0 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:44.044096 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7c5b317e-bd08-4fae-856e-7fb948219ac0 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:44.044586 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7c5b317e-bd08-4fae-856e-7fb948219ac0 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:44.045027 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7c5b317e-bd08-4fae-856e-7fb948219ac0 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:44.045485 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.objects.instance [None req-7c5b317e-bd08-4fae-856e-7fb948219ac0 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lazy-loading 'fault' on Instance uuid f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b {{(pid=124682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:41:44.086439 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-7c5b317e-bd08-4fae-856e-7fb948219ac0 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:41:44.095835 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-7c5b317e-bd08-4fae-856e-7fb948219ac0 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b" status: 200 len: 1331 microversion: 2.1 time: 0.100880 Aug 10 11:41:44.100155 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 429/858] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:41:43 2022] GET /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b => generated 1331 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:41:45.120082 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-32700050-aa6c-4711-8191-aaeb86b25e31 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:45.120809 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-32700050-aa6c-4711-8191-aaeb86b25e31 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:45.127693 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-32700050-aa6c-4711-8191-aaeb86b25e31 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:45.128219 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-32700050-aa6c-4711-8191-aaeb86b25e31 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:45.128743 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-32700050-aa6c-4711-8191-aaeb86b25e31 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:45.129314 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-32700050-aa6c-4711-8191-aaeb86b25e31 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:45.129766 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-32700050-aa6c-4711-8191-aaeb86b25e31 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:45.130189 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-32700050-aa6c-4711-8191-aaeb86b25e31 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:45.144166 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-32700050-aa6c-4711-8191-aaeb86b25e31 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] HTTP exception thrown: Instance f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b could not be found. Aug 10 11:41:45.145777 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-32700050-aa6c-4711-8191-aaeb86b25e31 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Request method failure captured: Aug 10 11:41:45.145777 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: request: GET /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b HTTP/1.1 Aug 10 11:41:45.145777 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept: application/json Aug 10 11:41:45.145777 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Aug 10 11:41:45.145777 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Connection: close Aug 10 11:41:45.145777 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Length: 0 Aug 10 11:41:45.145777 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Type: application/json Aug 10 11:41:45.145777 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Host: 10.222.0.62 Aug 10 11:41:45.145777 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Aug 10 11:41:45.145777 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.11 Aug 10 11:41:45.145777 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABi85j1Z_p4bHKfDtwCR5cI1vKkiUevZtLfKhR9gL2L4p6ZI7z3LVXhoVJRxMT9yim4mKqNT-79-8TxG-8rnVFFKy2oTj_gW51D7DVPA8mVxBXOeNjZ-pLCQGa21yrFE589EN2VLmuGuTme3GLbMFo9BJLvvm35OiLTdXNpruXqVvI3eZI Aug 10 11:41:45.145777 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Aug 10 11:41:45.145777 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Aug 10 11:41:45.145777 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Aug 10 11:41:45.145777 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Aug 10 11:41:45.145777 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Aug 10 11:41:45.145777 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Aug 10 11:41:45.145777 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Id: 1275e554301b4d019da34186581fc0da Aug 10 11:41:45.145777 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-AttachVolumeNegativeTest-1707340158 Aug 10 11:41:45.145777 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Role: member,reader Aug 10 11:41:45.145777 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Aug 10 11:41:45.147365 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1275e554301b4d019da34186581fc0da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1275e554301b4d019da34186581fc0da", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1275e554301b4d019da34186581fc0da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1275e554301b4d019da34186581fc0da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:41:45.147365 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-AttachVolumeNegativeTest-1707340158 Aug 10 11:41:45.147365 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Id: 1275e554301b4d019da34186581fc0da Aug 10 11:41:45.147365 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1707340158 Aug 10 11:41:45.147365 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User: tempest-AttachVolumeNegativeTest-1707340158-project Aug 10 11:41:45.147365 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Aug 10 11:41:45.147365 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Aug 10 11:41:45.147365 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Id: 4f61f9a578834243b0d11888c397deff Aug 10 11:41:45.147365 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-AttachVolumeNegativeTest-1707340158-project Aug 10 11:41:45.147365 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: method: > Aug 10 11:41:45.147365 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: exception: Instance f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b could not be found. Aug 10 11:41:45.147365 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: action_args: {'id': 'f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b'} Aug 10 11:41:45.148343 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:41:45.148343 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:41:45.148343 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:41:45.148343 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:41:45.148343 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:41:45.148343 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:41:45.148343 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:41:45.148343 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:41:45.148343 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:41:45.148343 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:41:45.148343 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b could not be found. Aug 10 11:41:45.148343 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:41:45.148343 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:41:45.148343 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:41:45.148343 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:41:45.148343 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:41:45.148343 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:41:45.148343 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:41:45.148343 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:41:45.148343 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:41:45.149954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:41:45.149954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:41:45.149954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:41:45.149954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:41:45.149954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:41:45.149954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:41:45.149954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:41:45.149954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b could not be found. Aug 10 11:41:45.149954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:41:45.149954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:41:45.149954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:41:45.149954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:41:45.149954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:41:45.149954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:41:45.149954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:41:45.149954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:41:45.149954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b could not be found. Aug 10 11:41:45.149954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:41:45.151466 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-32700050-aa6c-4711-8191-aaeb86b25e31 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Returning 404 to user: Instance f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b could not be found. {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:41:45.151466 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-32700050-aa6c-4711-8191-aaeb86b25e31 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b" status: 404 len: 111 microversion: 2.1 time: 0.032100 Aug 10 11:41:45.151466 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 430/859] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:41:45 2022] GET /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:41:45.156089 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-48ca87c2-5d8e-447d-a8f9-2ca6f2545b10 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '.version_select at 0x7fb7cdbe9dc0>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:45.219413 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-48ca87c2-5d8e-447d-a8f9-2ca6f2545b10 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-774838405" status: 202 len: 0 microversion: 2.1 time: 0.067092 Aug 10 11:41:45.220089 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 430/860] 10.222.0.62 () {58 vars in 1218 bytes} [Wed Aug 10 11:41:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-774838405 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:41:45.933364 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-b80d028b-9137-4a8f-9ed2-cb4a9c9480b4 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Action: 'create', calling method: .version_select at 0x7fb7cdb123a0>, body: {"keypair": {"name": "tempest-keypair-1736787440", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOxICCe/ARceI/NtWzOVdSJ+FOpvCU68Bb0TCrdeL/iuj7HNKeMt+ENiRJvS8wwA2Qd5ih0cctvvdbX/gdU7OgaVFRX6fCxM8cIV8tX7jTWTG5yQR1oPUd8rngPjR8mdsQ=="}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:41:45.951105 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-b80d028b-9137-4a8f-9ed2-cb4a9c9480b4 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Getting quotas for project 1275e554301b4d019da34186581fc0da. Resources: {'key_pairs'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:41:45.956888 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-b80d028b-9137-4a8f-9ed2-cb4a9c9480b4 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Getting quotas for user 4f61f9a578834243b0d11888c397deff and project 1275e554301b4d019da34186581fc0da. Resources: {'key_pairs'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:41:46.043129 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-b80d028b-9137-4a8f-9ed2-cb4a9c9480b4 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.114378 Aug 10 11:41:46.043840 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 431/861] 10.222.0.62 () {60 vars in 1159 bytes} [Wed Aug 10 11:41:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:41:48.296259 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-bb0c72da-47bb-46f9-b97d-278602298957 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1150537979", "imageRef": "99bbc441-5102-4a51-a496-cfbffeb3033a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9e8c6f11-9bc0-4d49-baa5-ecd5d8e7ec5d"}], "security_groups": [{"name": "tempest-securitygroup--17805682"}], "key_name": "tempest-keypair-1736787440", "user_data": "}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:41:48.305367 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=2 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:41:48.413035 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.network.neutron [None req-bb0c72da-47bb-46f9-b97d-278602298957 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] validate_networks() for [('9e8c6f11-9bc0-4d49-baa5-ecd5d8e7ec5d', None, None, None, None, None)] {{(pid=124682) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:41:48.768912 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-bb0c72da-47bb-46f9-b97d-278602298957 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Flavor limits 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:41:48.769341 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-bb0c72da-47bb-46f9-b97d-278602298957 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Image limits 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:41:48.769819 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-bb0c72da-47bb-46f9-b97d-278602298957 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Flavor pref 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:41:48.770233 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-bb0c72da-47bb-46f9-b97d-278602298957 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Image pref 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:41:48.770649 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-bb0c72da-47bb-46f9-b97d-278602298957 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:41:48.779290 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bb0c72da-47bb-46f9-b97d-278602298957 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:48.779773 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bb0c72da-47bb-46f9-b97d-278602298957 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:48.780258 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bb0c72da-47bb-46f9-b97d-278602298957 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:48.781496 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bb0c72da-47bb-46f9-b97d-278602298957 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:48.781955 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bb0c72da-47bb-46f9-b97d-278602298957 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:48.782387 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bb0c72da-47bb-46f9-b97d-278602298957 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:48.799427 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-bb0c72da-47bb-46f9-b97d-278602298957 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Getting quotas for project 1275e554301b4d019da34186581fc0da. Resources: {'ram', 'instances', 'cores'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:41:48.803364 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-bb0c72da-47bb-46f9-b97d-278602298957 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Getting quotas for user 4f61f9a578834243b0d11888c397deff and project 1275e554301b4d019da34186581fc0da. Resources: {'ram', 'instances', 'cores'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:41:48.814281 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-bb0c72da-47bb-46f9-b97d-278602298957 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Going to run 1 instances... {{(pid=124682) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:41:48.816576 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-bb0c72da-47bb-46f9-b97d-278602298957 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: 068eca04-664e-4a6e-b2cb-23b0b980c8f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99bbc441-5102-4a51-a496-cfbffeb3033a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:41:48.934292 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-bb0c72da-47bb-46f9-b97d-278602298957 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.642996 Aug 10 11:41:48.934934 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 431/862] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Aug 10 11:41:48 2022] POST /compute/v2.1/servers => generated 400 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 11:41:48.945821 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-55418a36-bb45-460c-bef0-1e25049ca729 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:48.946599 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-55418a36-bb45-460c-bef0-1e25049ca729 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: 068eca04-664e-4a6e-b2cb-23b0b980c8f3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:49.003898 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-55418a36-bb45-460c-bef0-1e25049ca729 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:41:49.011299 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-55418a36-bb45-460c-bef0-1e25049ca729 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3" status: 200 len: 1242 microversion: 2.1 time: 0.069269 Aug 10 11:41:49.012245 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 432/863] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:41:48 2022] GET /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3 => generated 1242 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:41:50.034062 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-27c13eb2-6150-46d7-85db-4f39206404d3 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:50.034689 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-27c13eb2-6150-46d7-85db-4f39206404d3 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: 068eca04-664e-4a6e-b2cb-23b0b980c8f3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:50.041552 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-27c13eb2-6150-46d7-85db-4f39206404d3 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:50.042229 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-27c13eb2-6150-46d7-85db-4f39206404d3 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:50.042671 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-27c13eb2-6150-46d7-85db-4f39206404d3 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:50.043366 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-27c13eb2-6150-46d7-85db-4f39206404d3 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:50.043825 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-27c13eb2-6150-46d7-85db-4f39206404d3 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:50.044281 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-27c13eb2-6150-46d7-85db-4f39206404d3 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:50.106769 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-27c13eb2-6150-46d7-85db-4f39206404d3 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:41:50.114664 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-27c13eb2-6150-46d7-85db-4f39206404d3 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3" status: 200 len: 1238 microversion: 2.1 time: 0.085974 Aug 10 11:41:50.115229 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 432/864] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:41:50 2022] GET /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3 => generated 1238 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:41:51.135336 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-0ad85695-776a-4287-8941-9c9a3dfc45b6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:51.136150 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-0ad85695-776a-4287-8941-9c9a3dfc45b6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: 068eca04-664e-4a6e-b2cb-23b0b980c8f3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:51.143820 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0ad85695-776a-4287-8941-9c9a3dfc45b6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:51.144440 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0ad85695-776a-4287-8941-9c9a3dfc45b6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:51.147946 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0ad85695-776a-4287-8941-9c9a3dfc45b6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:51.147946 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0ad85695-776a-4287-8941-9c9a3dfc45b6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:51.147946 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0ad85695-776a-4287-8941-9c9a3dfc45b6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:51.147946 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0ad85695-776a-4287-8941-9c9a3dfc45b6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:51.223326 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-0ad85695-776a-4287-8941-9c9a3dfc45b6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:41:51.230922 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-0ad85695-776a-4287-8941-9c9a3dfc45b6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3" status: 200 len: 1300 microversion: 2.1 time: 0.099723 Aug 10 11:41:51.231491 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 433/865] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:41:51 2022] GET /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3 => generated 1300 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:41:52.256734 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-18befa21-2138-4d2b-aa25-727fa11df3fe tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:52.257347 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-18befa21-2138-4d2b-aa25-727fa11df3fe tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: 068eca04-664e-4a6e-b2cb-23b0b980c8f3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:52.263901 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-18befa21-2138-4d2b-aa25-727fa11df3fe tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:52.264481 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-18befa21-2138-4d2b-aa25-727fa11df3fe tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:52.264914 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-18befa21-2138-4d2b-aa25-727fa11df3fe tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:52.266156 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-18befa21-2138-4d2b-aa25-727fa11df3fe tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:52.266725 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-18befa21-2138-4d2b-aa25-727fa11df3fe tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:52.267317 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-18befa21-2138-4d2b-aa25-727fa11df3fe tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:52.408179 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-18befa21-2138-4d2b-aa25-727fa11df3fe tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:41:52.416116 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-18befa21-2138-4d2b-aa25-727fa11df3fe tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3" status: 200 len: 1366 microversion: 2.1 time: 0.163135 Aug 10 11:41:52.416688 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 433/866] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:41:52 2022] GET /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:41:52.488285 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-ed4cbecc-1a60-498b-800a-2180d4509540 req-957c5902-c487-4695-a00c-e0a9f47854ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "068eca04-664e-4a6e-b2cb-23b0b980c8f3", "tag": "a1400c37-bfdc-4c25-a06c-1aead2a0756b"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:41:52.497645 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-ed4cbecc-1a60-498b-800a-2180d4509540 req-957c5902-c487-4695-a00c-e0a9f47854ec service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:52.498113 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-ed4cbecc-1a60-498b-800a-2180d4509540 req-957c5902-c487-4695-a00c-e0a9f47854ec service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:52.498536 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-ed4cbecc-1a60-498b-800a-2180d4509540 req-957c5902-c487-4695-a00c-e0a9f47854ec service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:52.511510 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-ed4cbecc-1a60-498b-800a-2180d4509540 req-957c5902-c487-4695-a00c-e0a9f47854ec service nova] Creating event network-changed:a1400c37-bfdc-4c25-a06c-1aead2a0756b for instance 068eca04-664e-4a6e-b2cb-23b0b980c8f3 on hv-cinder-85272 Aug 10 11:41:52.517644 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-ed4cbecc-1a60-498b-800a-2180d4509540 req-957c5902-c487-4695-a00c-e0a9f47854ec service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033114 Aug 10 11:41:52.518232 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 434/867] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:41:53.436906 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-5cb1b18c-fe81-495d-ab20-27600779717c tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:53.437609 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-5cb1b18c-fe81-495d-ab20-27600779717c tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: 068eca04-664e-4a6e-b2cb-23b0b980c8f3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:53.444034 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5cb1b18c-fe81-495d-ab20-27600779717c tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:53.444516 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5cb1b18c-fe81-495d-ab20-27600779717c tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:53.444954 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5cb1b18c-fe81-495d-ab20-27600779717c tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:53.445639 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5cb1b18c-fe81-495d-ab20-27600779717c tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:53.446093 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5cb1b18c-fe81-495d-ab20-27600779717c tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:53.446534 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5cb1b18c-fe81-495d-ab20-27600779717c tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:53.724622 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-5cb1b18c-fe81-495d-ab20-27600779717c tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:41:53.731888 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-5cb1b18c-fe81-495d-ab20-27600779717c tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3" status: 200 len: 1366 microversion: 2.1 time: 0.298844 Aug 10 11:41:53.732488 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 434/868] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:41:53 2022] GET /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3 => generated 1366 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:41:54.754056 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-e3a67e86-6c76-4c59-88a4-5b7ac3375478 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:54.754764 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-e3a67e86-6c76-4c59-88a4-5b7ac3375478 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: 068eca04-664e-4a6e-b2cb-23b0b980c8f3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:54.760876 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e3a67e86-6c76-4c59-88a4-5b7ac3375478 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:54.761359 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e3a67e86-6c76-4c59-88a4-5b7ac3375478 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:54.761795 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e3a67e86-6c76-4c59-88a4-5b7ac3375478 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:54.762478 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e3a67e86-6c76-4c59-88a4-5b7ac3375478 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:54.762934 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e3a67e86-6c76-4c59-88a4-5b7ac3375478 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:54.763361 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e3a67e86-6c76-4c59-88a4-5b7ac3375478 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:54.899798 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-e3a67e86-6c76-4c59-88a4-5b7ac3375478 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:41:54.907804 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-e3a67e86-6c76-4c59-88a4-5b7ac3375478 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3" status: 200 len: 1366 microversion: 2.1 time: 0.159026 Aug 10 11:41:54.908393 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 435/869] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:41:54 2022] GET /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:41:55.928261 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-0ffcd027-ecc6-4d5c-859f-bbb17342c8cb tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:55.928869 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-0ffcd027-ecc6-4d5c-859f-bbb17342c8cb tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: 068eca04-664e-4a6e-b2cb-23b0b980c8f3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:55.935168 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0ffcd027-ecc6-4d5c-859f-bbb17342c8cb tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:55.935647 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0ffcd027-ecc6-4d5c-859f-bbb17342c8cb tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:55.936112 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0ffcd027-ecc6-4d5c-859f-bbb17342c8cb tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:55.936803 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0ffcd027-ecc6-4d5c-859f-bbb17342c8cb tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:55.937242 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0ffcd027-ecc6-4d5c-859f-bbb17342c8cb tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:55.937662 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0ffcd027-ecc6-4d5c-859f-bbb17342c8cb tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:56.064939 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-0ffcd027-ecc6-4d5c-859f-bbb17342c8cb tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:41:56.072438 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-0ffcd027-ecc6-4d5c-859f-bbb17342c8cb tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3" status: 200 len: 1366 microversion: 2.1 time: 0.148004 Aug 10 11:41:56.072994 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 435/870] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:41:55 2022] GET /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:41:57.098332 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f30a6f49-4d1e-444b-b78d-15663c33228c tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:57.099043 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-f30a6f49-4d1e-444b-b78d-15663c33228c tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: 068eca04-664e-4a6e-b2cb-23b0b980c8f3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:57.107368 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f30a6f49-4d1e-444b-b78d-15663c33228c tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:57.107853 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f30a6f49-4d1e-444b-b78d-15663c33228c tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:57.108316 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f30a6f49-4d1e-444b-b78d-15663c33228c tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:57.109040 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f30a6f49-4d1e-444b-b78d-15663c33228c tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:57.109528 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f30a6f49-4d1e-444b-b78d-15663c33228c tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:57.109917 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f30a6f49-4d1e-444b-b78d-15663c33228c tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:57.242829 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-f30a6f49-4d1e-444b-b78d-15663c33228c tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:41:57.250388 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-f30a6f49-4d1e-444b-b78d-15663c33228c tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3" status: 200 len: 1366 microversion: 2.1 time: 0.155778 Aug 10 11:41:57.250952 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 436/871] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:41:57 2022] GET /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:41:58.270826 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-43391815-9470-49e6-b616-99e18eea3f5b tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:58.271445 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-43391815-9470-49e6-b616-99e18eea3f5b tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: 068eca04-664e-4a6e-b2cb-23b0b980c8f3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:58.278196 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-43391815-9470-49e6-b616-99e18eea3f5b tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:58.278291 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-43391815-9470-49e6-b616-99e18eea3f5b tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:58.278790 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-43391815-9470-49e6-b616-99e18eea3f5b tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:58.279484 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-43391815-9470-49e6-b616-99e18eea3f5b tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:58.279945 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-43391815-9470-49e6-b616-99e18eea3f5b tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:58.280448 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-43391815-9470-49e6-b616-99e18eea3f5b tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:58.411658 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-43391815-9470-49e6-b616-99e18eea3f5b tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:41:58.419049 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-43391815-9470-49e6-b616-99e18eea3f5b tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3" status: 200 len: 1366 microversion: 2.1 time: 0.152094 Aug 10 11:41:58.419604 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 436/872] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:41:58 2022] GET /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:41:59.219218 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-15056021-1489-4489-872e-f6cf9c9b06d6 req-9ff90820-5ca7-4f56-81fa-2af5b7220aa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "068eca04-664e-4a6e-b2cb-23b0b980c8f3", "name": "network-vif-plugged", "status": "completed", "tag": "a1400c37-bfdc-4c25-a06c-1aead2a0756b"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:41:59.224695 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=6 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:41:59.229950 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-15056021-1489-4489-872e-f6cf9c9b06d6 req-9ff90820-5ca7-4f56-81fa-2af5b7220aa8 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:59.230430 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-15056021-1489-4489-872e-f6cf9c9b06d6 req-9ff90820-5ca7-4f56-81fa-2af5b7220aa8 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:59.230860 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-15056021-1489-4489-872e-f6cf9c9b06d6 req-9ff90820-5ca7-4f56-81fa-2af5b7220aa8 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:59.242675 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-15056021-1489-4489-872e-f6cf9c9b06d6 req-9ff90820-5ca7-4f56-81fa-2af5b7220aa8 service nova] Creating event network-vif-plugged:a1400c37-bfdc-4c25-a06c-1aead2a0756b for instance 068eca04-664e-4a6e-b2cb-23b0b980c8f3 on hv-cinder-85272 Aug 10 11:41:59.247455 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-15056021-1489-4489-872e-f6cf9c9b06d6 req-9ff90820-5ca7-4f56-81fa-2af5b7220aa8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032465 Aug 10 11:41:59.248177 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 437/873] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:41:59.441741 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-aadbf3cb-9f8d-48b9-a1f9-50a0f2fc482f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:41:59.442523 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-aadbf3cb-9f8d-48b9-a1f9-50a0f2fc482f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: 068eca04-664e-4a6e-b2cb-23b0b980c8f3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:41:59.444501 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=2 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:41:59.445160 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=6 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:41:59.449890 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-aadbf3cb-9f8d-48b9-a1f9-50a0f2fc482f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:59.450377 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-aadbf3cb-9f8d-48b9-a1f9-50a0f2fc482f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:59.450816 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-aadbf3cb-9f8d-48b9-a1f9-50a0f2fc482f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:59.451571 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-aadbf3cb-9f8d-48b9-a1f9-50a0f2fc482f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:41:59.451999 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-aadbf3cb-9f8d-48b9-a1f9-50a0f2fc482f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:41:59.452448 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-aadbf3cb-9f8d-48b9-a1f9-50a0f2fc482f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:41:59.584641 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-aadbf3cb-9f8d-48b9-a1f9-50a0f2fc482f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:41:59.591854 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-aadbf3cb-9f8d-48b9-a1f9-50a0f2fc482f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3" status: 200 len: 1366 microversion: 2.1 time: 0.154845 Aug 10 11:41:59.592461 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 437/874] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:41:59 2022] GET /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:42:00.613888 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-15828cb0-dc84-48bb-9a9d-5ee0b3218fd2 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:42:00.614660 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-15828cb0-dc84-48bb-9a9d-5ee0b3218fd2 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: 068eca04-664e-4a6e-b2cb-23b0b980c8f3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:42:00.621267 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-15828cb0-dc84-48bb-9a9d-5ee0b3218fd2 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:00.621758 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-15828cb0-dc84-48bb-9a9d-5ee0b3218fd2 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:00.622203 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-15828cb0-dc84-48bb-9a9d-5ee0b3218fd2 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:00.622902 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-15828cb0-dc84-48bb-9a9d-5ee0b3218fd2 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:00.623360 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-15828cb0-dc84-48bb-9a9d-5ee0b3218fd2 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:00.623787 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-15828cb0-dc84-48bb-9a9d-5ee0b3218fd2 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:00.644054 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:42:00.762404 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-15828cb0-dc84-48bb-9a9d-5ee0b3218fd2 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:42:00.770892 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-15828cb0-dc84-48bb-9a9d-5ee0b3218fd2 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3" status: 200 len: 1366 microversion: 2.1 time: 0.162364 Aug 10 11:42:00.771459 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 438/875] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:42:00 2022] GET /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:42:01.792544 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-a804f052-4226-4111-b767-ab895af9d37f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:42:01.793158 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-a804f052-4226-4111-b767-ab895af9d37f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: 068eca04-664e-4a6e-b2cb-23b0b980c8f3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:42:01.799781 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a804f052-4226-4111-b767-ab895af9d37f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:01.800291 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a804f052-4226-4111-b767-ab895af9d37f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:01.800728 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a804f052-4226-4111-b767-ab895af9d37f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:01.801418 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a804f052-4226-4111-b767-ab895af9d37f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:01.801873 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a804f052-4226-4111-b767-ab895af9d37f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:01.802295 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a804f052-4226-4111-b767-ab895af9d37f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:01.820312 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:42:01.929275 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-a804f052-4226-4111-b767-ab895af9d37f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:42:01.936636 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-a804f052-4226-4111-b767-ab895af9d37f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3" status: 200 len: 1557 microversion: 2.1 time: 0.147925 Aug 10 11:42:01.937227 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 438/876] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:42:01 2022] GET /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3 => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:42:01.957090 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-282ea948-a9be-45e8-9721-5b3b38324de5 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:42:01.957593 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-282ea948-a9be-45e8-9721-5b3b38324de5 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: 068eca04-664e-4a6e-b2cb-23b0b980c8f3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:42:01.964341 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-282ea948-a9be-45e8-9721-5b3b38324de5 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:01.964829 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-282ea948-a9be-45e8-9721-5b3b38324de5 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:01.965271 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-282ea948-a9be-45e8-9721-5b3b38324de5 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:01.965968 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-282ea948-a9be-45e8-9721-5b3b38324de5 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:01.966421 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-282ea948-a9be-45e8-9721-5b3b38324de5 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:01.966857 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-282ea948-a9be-45e8-9721-5b3b38324de5 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:02.052122 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-282ea948-a9be-45e8-9721-5b3b38324de5 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098870 Aug 10 11:42:02.052720 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 439/877] 10.222.0.62 () {58 vars in 1275 bytes} [Wed Aug 10 11:42:01 2022] GET /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:42:03.276033 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-0b1150b7-3f0b-4cfb-b62d-d9b8d530a2ba req-d7623ee8-2b5a-4902-834d-6e4858316fbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "068eca04-664e-4a6e-b2cb-23b0b980c8f3", "tag": "a1400c37-bfdc-4c25-a06c-1aead2a0756b"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:42:03.286578 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-0b1150b7-3f0b-4cfb-b62d-d9b8d530a2ba req-d7623ee8-2b5a-4902-834d-6e4858316fbe service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:03.287050 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-0b1150b7-3f0b-4cfb-b62d-d9b8d530a2ba req-d7623ee8-2b5a-4902-834d-6e4858316fbe service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:03.287477 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-0b1150b7-3f0b-4cfb-b62d-d9b8d530a2ba req-d7623ee8-2b5a-4902-834d-6e4858316fbe service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:03.299061 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-0b1150b7-3f0b-4cfb-b62d-d9b8d530a2ba req-d7623ee8-2b5a-4902-834d-6e4858316fbe service nova] Creating event network-changed:a1400c37-bfdc-4c25-a06c-1aead2a0756b for instance 068eca04-664e-4a6e-b2cb-23b0b980c8f3 on hv-cinder-85272 Aug 10 11:42:03.304215 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-0b1150b7-3f0b-4cfb-b62d-d9b8d530a2ba req-d7623ee8-2b5a-4902-834d-6e4858316fbe service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031718 Aug 10 11:42:03.304800 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 439/878] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:42:39.223322 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:42:39.224193 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=6 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:42:39.228189 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-39ed558a-cf3b-4c56-9e12-802e8e5996b4 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:42:39.228691 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-39ed558a-cf3b-4c56-9e12-802e8e5996b4 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: 068eca04-664e-4a6e-b2cb-23b0b980c8f3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:42:39.235172 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-39ed558a-cf3b-4c56-9e12-802e8e5996b4 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:39.236938 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-39ed558a-cf3b-4c56-9e12-802e8e5996b4 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:39.236938 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-39ed558a-cf3b-4c56-9e12-802e8e5996b4 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:39.236938 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-39ed558a-cf3b-4c56-9e12-802e8e5996b4 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:39.237231 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-39ed558a-cf3b-4c56-9e12-802e8e5996b4 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:39.237654 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-39ed558a-cf3b-4c56-9e12-802e8e5996b4 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:39.260702 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-39ed558a-cf3b-4c56-9e12-802e8e5996b4 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3/ips" status: 200 len: 150 microversion: 2.1 time: 0.038749 Aug 10 11:42:39.265804 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 440/879] 10.222.0.62 () {58 vars in 1248 bytes} [Wed Aug 10 11:42:39 2022] GET /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:42:40.870017 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-a8e39af3-3f3e-48ce-adb8-e81b6ebc7427 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "152b2578-378f-480b-979d-c23770795315"}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:42:40.872482 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-a8e39af3-3f3e-48ce-adb8-e81b6ebc7427 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: 068eca04-664e-4a6e-b2cb-23b0b980c8f3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:42:40.875464 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:42:40.876138 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=4 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:42:40.882299 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a8e39af3-3f3e-48ce-adb8-e81b6ebc7427 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:40.883066 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a8e39af3-3f3e-48ce-adb8-e81b6ebc7427 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:40.883710 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a8e39af3-3f3e-48ce-adb8-e81b6ebc7427 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:40.884637 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a8e39af3-3f3e-48ce-adb8-e81b6ebc7427 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:40.885088 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a8e39af3-3f3e-48ce-adb8-e81b6ebc7427 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:40.888108 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a8e39af3-3f3e-48ce-adb8-e81b6ebc7427 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:41.678228 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-a8e39af3-3f3e-48ce-adb8-e81b6ebc7427 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "POST /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.812507 Aug 10 11:42:41.678842 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 440/880] 10.222.0.62 () {60 vars in 1323 bytes} [Wed Aug 10 11:42:40 2022] POST /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3/os-volume_attachments => generated 194 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:42:49.204560 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-d63b31d2-2259-44e1-87ad-8fbe108d52d0 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "152b2578-378f-480b-979d-c23770795315"}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:42:49.206884 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-d63b31d2-2259-44e1-87ad-8fbe108d52d0 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: 068eca04-664e-4a6e-b2cb-23b0b980c8f3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:42:49.213999 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d63b31d2-2259-44e1-87ad-8fbe108d52d0 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:49.214491 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d63b31d2-2259-44e1-87ad-8fbe108d52d0 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:49.214928 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d63b31d2-2259-44e1-87ad-8fbe108d52d0 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:49.215645 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d63b31d2-2259-44e1-87ad-8fbe108d52d0 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:49.216130 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d63b31d2-2259-44e1-87ad-8fbe108d52d0 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:49.216561 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d63b31d2-2259-44e1-87ad-8fbe108d52d0 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:49.353586 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-d63b31d2-2259-44e1-87ad-8fbe108d52d0 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] HTTP exception thrown: Invalid volume: volume 152b2578-378f-480b-979d-c23770795315 is already attached to instances: 068eca04-664e-4a6e-b2cb-23b0b980c8f3 Aug 10 11:42:49.355314 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-d63b31d2-2259-44e1-87ad-8fbe108d52d0 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Request method failure captured: Aug 10 11:42:49.355314 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: request: POST /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3/os-volume_attachments HTTP/1.1 Aug 10 11:42:49.355314 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept: application/json Aug 10 11:42:49.355314 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Aug 10 11:42:49.355314 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Connection: close Aug 10 11:42:49.355314 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Length: 74 Aug 10 11:42:49.355314 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Type: application/json Aug 10 11:42:49.355314 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Host: 10.222.0.62 Aug 10 11:42:49.355314 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Aug 10 11:42:49.355314 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.11 Aug 10 11:42:49.355314 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABi85j1Z_p4bHKfDtwCR5cI1vKkiUevZtLfKhR9gL2L4p6ZI7z3LVXhoVJRxMT9yim4mKqNT-79-8TxG-8rnVFFKy2oTj_gW51D7DVPA8mVxBXOeNjZ-pLCQGa21yrFE589EN2VLmuGuTme3GLbMFo9BJLvvm35OiLTdXNpruXqVvI3eZI Aug 10 11:42:49.355314 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Aug 10 11:42:49.355314 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Aug 10 11:42:49.355314 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Aug 10 11:42:49.355314 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Aug 10 11:42:49.355314 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Aug 10 11:42:49.355314 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Aug 10 11:42:49.355314 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Id: 1275e554301b4d019da34186581fc0da Aug 10 11:42:49.355314 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-AttachVolumeNegativeTest-1707340158 Aug 10 11:42:49.355314 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Role: member,reader Aug 10 11:42:49.355314 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Aug 10 11:42:49.357071 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1275e554301b4d019da34186581fc0da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1275e554301b4d019da34186581fc0da", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1275e554301b4d019da34186581fc0da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1275e554301b4d019da34186581fc0da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:42:49.357071 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-AttachVolumeNegativeTest-1707340158 Aug 10 11:42:49.357071 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Id: 1275e554301b4d019da34186581fc0da Aug 10 11:42:49.357071 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1707340158 Aug 10 11:42:49.357071 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User: tempest-AttachVolumeNegativeTest-1707340158-project Aug 10 11:42:49.357071 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Aug 10 11:42:49.357071 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Aug 10 11:42:49.357071 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Id: 4f61f9a578834243b0d11888c397deff Aug 10 11:42:49.357071 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-AttachVolumeNegativeTest-1707340158-project Aug 10 11:42:49.357071 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Aug 10 11:42:49.357071 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: {"volumeAttachment": {"volumeId": "152b2578-378f-480b-979d-c23770795315"}} Aug 10 11:42:49.357071 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: method: > Aug 10 11:42:49.358082 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: exception: Invalid volume: volume 152b2578-378f-480b-979d-c23770795315 is already attached to instances: 068eca04-664e-4a6e-b2cb-23b0b980c8f3 Aug 10 11:42:49.358082 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: action_args: {'server_id': '068eca04-664e-4a6e-b2cb-23b0b980c8f3', 'body': {'volumeAttachment': {'volumeId': '152b2578-378f-480b-979d-c23770795315'}}} Aug 10 11:42:49.358082 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:42:49.358082 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:42:49.358082 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 10 11:42:49.358082 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 10 11:42:49.358082 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 11:42:49.358082 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 11:42:49.358082 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 10 11:42:49.358082 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 10 11:42:49.358082 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 10 11:42:49.358082 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 10 11:42:49.358082 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 10 11:42:49.358082 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 10 11:42:49.358082 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 152b2578-378f-480b-979d-c23770795315 is already attached to instances: 068eca04-664e-4a6e-b2cb-23b0b980c8f3 Aug 10 11:42:49.358082 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:42:49.358082 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:42:49.358082 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:42:49.358082 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:42:49.359412 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:42:49.359412 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:42:49.359412 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:42:49.359412 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:42:49.359412 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:42:49.359412 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:42:49.359412 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 11:42:49.359412 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 11:42:49.359412 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 11:42:49.359412 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 11:42:49.359412 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 11:42:49.359412 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 11:42:49.359412 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 10 11:42:49.359412 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 10 11:42:49.359412 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 152b2578-378f-480b-979d-c23770795315 is already attached to instances: 068eca04-664e-4a6e-b2cb-23b0b980c8f3 Aug 10 11:42:49.359412 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:42:49.359412 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:42:49.359412 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:42:49.359412 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:42:49.359412 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:42:49.360790 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:42:49.360790 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:42:49.360790 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:42:49.360790 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 152b2578-378f-480b-979d-c23770795315 is already attached to instances: 068eca04-664e-4a6e-b2cb-23b0b980c8f3 Aug 10 11:42:49.360790 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:42:49.360790 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-d63b31d2-2259-44e1-87ad-8fbe108d52d0 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Returning 400 to user: Invalid volume: volume 152b2578-378f-480b-979d-c23770795315 is already attached to instances: 068eca04-664e-4a6e-b2cb-23b0b980c8f3 {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:42:49.360790 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-d63b31d2-2259-44e1-87ad-8fbe108d52d0 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "POST /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.157137 Aug 10 11:42:49.360790 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 441/881] 10.222.0.62 () {60 vars in 1323 bytes} [Wed Aug 10 11:42:49 2022] POST /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3/os-volume_attachments => generated 174 bytes in 158 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 11:42:49.420354 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-6d8790f0-3c0a-47d2-bcd7-3fd64c776c06 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:42:49.420932 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-6d8790f0-3c0a-47d2-bcd7-3fd64c776c06 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: 068eca04-664e-4a6e-b2cb-23b0b980c8f3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:42:49.427589 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6d8790f0-3c0a-47d2-bcd7-3fd64c776c06 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:49.428105 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6d8790f0-3c0a-47d2-bcd7-3fd64c776c06 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:49.428538 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6d8790f0-3c0a-47d2-bcd7-3fd64c776c06 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:49.429216 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6d8790f0-3c0a-47d2-bcd7-3fd64c776c06 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:49.429663 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6d8790f0-3c0a-47d2-bcd7-3fd64c776c06 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:49.430085 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6d8790f0-3c0a-47d2-bcd7-3fd64c776c06 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:49.509255 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.objects.instance [None req-6d8790f0-3c0a-47d2-bcd7-3fd64c776c06 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lazy-loading 'services' on Instance uuid 068eca04-664e-4a6e-b2cb-23b0b980c8f3 {{(pid=124682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:42:49.775746 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-6d8790f0-3c0a-47d2-bcd7-3fd64c776c06 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "DELETE /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3/os-volume_attachments/152b2578-378f-480b-979d-c23770795315" status: 202 len: 0 microversion: 2.1 time: 0.359349 Aug 10 11:42:49.776296 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 441/882] 10.222.0.62 () {58 vars in 1416 bytes} [Wed Aug 10 11:42:49 2022] DELETE /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3/os-volume_attachments/152b2578-378f-480b-979d-c23770795315 => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:42:49.785063 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-5c05582c-2403-4dac-82d9-6d3f13a471a1 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:42:49.787330 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-5c05582c-2403-4dac-82d9-6d3f13a471a1 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: 068eca04-664e-4a6e-b2cb-23b0b980c8f3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:42:49.794361 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5c05582c-2403-4dac-82d9-6d3f13a471a1 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:49.794848 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5c05582c-2403-4dac-82d9-6d3f13a471a1 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:49.795282 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5c05582c-2403-4dac-82d9-6d3f13a471a1 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:49.796073 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5c05582c-2403-4dac-82d9-6d3f13a471a1 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:49.796530 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5c05582c-2403-4dac-82d9-6d3f13a471a1 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:49.796956 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5c05582c-2403-4dac-82d9-6d3f13a471a1 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:49.831480 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-5c05582c-2403-4dac-82d9-6d3f13a471a1 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050622 Aug 10 11:42:49.832050 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 442/883] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 10 11:42:49 2022] GET /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:42:50.844924 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-2f879830-bf14-46fb-98a3-db280abd102a tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:42:50.847126 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-2f879830-bf14-46fb-98a3-db280abd102a tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: 068eca04-664e-4a6e-b2cb-23b0b980c8f3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:42:50.853321 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2f879830-bf14-46fb-98a3-db280abd102a tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:50.853802 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2f879830-bf14-46fb-98a3-db280abd102a tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:50.854235 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2f879830-bf14-46fb-98a3-db280abd102a tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:50.854911 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2f879830-bf14-46fb-98a3-db280abd102a tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:50.855370 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2f879830-bf14-46fb-98a3-db280abd102a tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:50.855774 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2f879830-bf14-46fb-98a3-db280abd102a tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:50.884817 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-2f879830-bf14-46fb-98a3-db280abd102a tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044753 Aug 10 11:42:50.885354 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 442/884] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 10 11:42:50 2022] GET /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 11:42:50.951289 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-80a53781-39fe-438f-8ea2-a6ae8a1ad2e7 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:42:50.951861 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-80a53781-39fe-438f-8ea2-a6ae8a1ad2e7 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: 068eca04-664e-4a6e-b2cb-23b0b980c8f3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:42:50.958281 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-80a53781-39fe-438f-8ea2-a6ae8a1ad2e7 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:50.958772 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-80a53781-39fe-438f-8ea2-a6ae8a1ad2e7 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:50.961650 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-80a53781-39fe-438f-8ea2-a6ae8a1ad2e7 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:50.961650 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-80a53781-39fe-438f-8ea2-a6ae8a1ad2e7 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:50.961650 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-80a53781-39fe-438f-8ea2-a6ae8a1ad2e7 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:50.961650 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-80a53781-39fe-438f-8ea2-a6ae8a1ad2e7 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:50.986263 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-80a53781-39fe-438f-8ea2-a6ae8a1ad2e7 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: 068eca04-664e-4a6e-b2cb-23b0b980c8f3] Going to try to terminate instance {{(pid=124683) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:42:51.291359 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-80a53781-39fe-438f-8ea2-a6ae8a1ad2e7 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "DELETE /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3" status: 204 len: 0 microversion: 2.1 time: 0.343886 Aug 10 11:42:51.295203 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 443/885] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 10 11:42:50 2022] DELETE /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:42:51.300955 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-8d25ac17-7f1d-4849-8e33-d289cf24a937 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:42:51.301579 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-8d25ac17-7f1d-4849-8e33-d289cf24a937 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: 068eca04-664e-4a6e-b2cb-23b0b980c8f3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:42:51.307591 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8d25ac17-7f1d-4849-8e33-d289cf24a937 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:51.308098 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8d25ac17-7f1d-4849-8e33-d289cf24a937 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:51.311158 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8d25ac17-7f1d-4849-8e33-d289cf24a937 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:51.311158 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8d25ac17-7f1d-4849-8e33-d289cf24a937 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:51.311158 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8d25ac17-7f1d-4849-8e33-d289cf24a937 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:51.311158 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8d25ac17-7f1d-4849-8e33-d289cf24a937 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:51.445814 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-8d25ac17-7f1d-4849-8e33-d289cf24a937 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:42:51.454011 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-8d25ac17-7f1d-4849-8e33-d289cf24a937 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3" status: 200 len: 1681 microversion: 2.1 time: 0.157195 Aug 10 11:42:51.454566 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 443/886] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:42:51 2022] GET /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:42:52.475789 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-011865d9-061e-4b3d-a44e-b0a8f34c2284 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:42:52.476438 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-011865d9-061e-4b3d-a44e-b0a8f34c2284 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: 068eca04-664e-4a6e-b2cb-23b0b980c8f3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:42:52.482775 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-011865d9-061e-4b3d-a44e-b0a8f34c2284 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:52.483253 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-011865d9-061e-4b3d-a44e-b0a8f34c2284 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:52.483685 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-011865d9-061e-4b3d-a44e-b0a8f34c2284 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:52.484390 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-011865d9-061e-4b3d-a44e-b0a8f34c2284 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:52.485666 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-011865d9-061e-4b3d-a44e-b0a8f34c2284 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:52.486186 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-011865d9-061e-4b3d-a44e-b0a8f34c2284 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:52.618047 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-011865d9-061e-4b3d-a44e-b0a8f34c2284 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:42:52.626044 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-011865d9-061e-4b3d-a44e-b0a8f34c2284 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3" status: 200 len: 1681 microversion: 2.1 time: 0.154001 Aug 10 11:42:52.626607 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 444/887] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:42:52 2022] GET /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:42:53.629552 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-b174aacd-de7c-4499-8f36-32a88722421e req-33e5f175-337d-492e-b14f-02b83600d76a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "068eca04-664e-4a6e-b2cb-23b0b980c8f3", "name": "network-vif-deleted", "tag": "a1400c37-bfdc-4c25-a06c-1aead2a0756b"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:42:53.639231 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-b174aacd-de7c-4499-8f36-32a88722421e req-33e5f175-337d-492e-b14f-02b83600d76a service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:53.641471 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-b174aacd-de7c-4499-8f36-32a88722421e req-33e5f175-337d-492e-b14f-02b83600d76a service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:53.641471 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-b174aacd-de7c-4499-8f36-32a88722421e req-33e5f175-337d-492e-b14f-02b83600d76a service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:53.647689 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-1e329c4e-0282-4976-87e1-0da1423848da tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:42:53.648394 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-1e329c4e-0282-4976-87e1-0da1423848da tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: 068eca04-664e-4a6e-b2cb-23b0b980c8f3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:42:53.654784 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1e329c4e-0282-4976-87e1-0da1423848da tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:53.655266 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1e329c4e-0282-4976-87e1-0da1423848da tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:53.655697 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1e329c4e-0282-4976-87e1-0da1423848da tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:53.658284 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1e329c4e-0282-4976-87e1-0da1423848da tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:53.658817 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1e329c4e-0282-4976-87e1-0da1423848da tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:53.659219 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-b174aacd-de7c-4499-8f36-32a88722421e req-33e5f175-337d-492e-b14f-02b83600d76a service nova] Creating event network-vif-deleted:a1400c37-bfdc-4c25-a06c-1aead2a0756b for instance 068eca04-664e-4a6e-b2cb-23b0b980c8f3 on hv-cinder-85272 Aug 10 11:42:53.659400 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1e329c4e-0282-4976-87e1-0da1423848da tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:53.664238 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-b174aacd-de7c-4499-8f36-32a88722421e req-33e5f175-337d-492e-b14f-02b83600d76a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039214 Aug 10 11:42:53.664832 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 444/888] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:42:53.729276 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-1e329c4e-0282-4976-87e1-0da1423848da tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:42:53.738010 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-1e329c4e-0282-4976-87e1-0da1423848da tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3" status: 200 len: 1615 microversion: 2.1 time: 0.094145 Aug 10 11:42:53.738908 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 445/889] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:42:53 2022] GET /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3 => generated 1615 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:42:54.759585 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-f8be932a-8ced-4f73-b4e1-041ce97972fe tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:42:54.760378 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-f8be932a-8ced-4f73-b4e1-041ce97972fe tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: 068eca04-664e-4a6e-b2cb-23b0b980c8f3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:42:54.766668 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f8be932a-8ced-4f73-b4e1-041ce97972fe tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:54.767143 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f8be932a-8ced-4f73-b4e1-041ce97972fe tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:54.767571 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f8be932a-8ced-4f73-b4e1-041ce97972fe tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:54.768283 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f8be932a-8ced-4f73-b4e1-041ce97972fe tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:54.768757 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f8be932a-8ced-4f73-b4e1-041ce97972fe tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:54.769179 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f8be932a-8ced-4f73-b4e1-041ce97972fe tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:54.783197 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.wsgi [None req-f8be932a-8ced-4f73-b4e1-041ce97972fe tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] HTTP exception thrown: Instance 068eca04-664e-4a6e-b2cb-23b0b980c8f3 could not be found. Aug 10 11:42:54.784895 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-f8be932a-8ced-4f73-b4e1-041ce97972fe tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Request method failure captured: Aug 10 11:42:54.784895 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: request: GET /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3 HTTP/1.1 Aug 10 11:42:54.784895 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Accept: application/json Aug 10 11:42:54.784895 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Aug 10 11:42:54.784895 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Connection: close Aug 10 11:42:54.784895 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Content-Length: 0 Aug 10 11:42:54.784895 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Content-Type: application/json Aug 10 11:42:54.784895 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Host: 10.222.0.62 Aug 10 11:42:54.784895 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Aug 10 11:42:54.784895 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.11 Aug 10 11:42:54.784895 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABi85j1Z_p4bHKfDtwCR5cI1vKkiUevZtLfKhR9gL2L4p6ZI7z3LVXhoVJRxMT9yim4mKqNT-79-8TxG-8rnVFFKy2oTj_gW51D7DVPA8mVxBXOeNjZ-pLCQGa21yrFE589EN2VLmuGuTme3GLbMFo9BJLvvm35OiLTdXNpruXqVvI3eZI Aug 10 11:42:54.784895 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Aug 10 11:42:54.784895 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Aug 10 11:42:54.784895 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Aug 10 11:42:54.784895 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Aug 10 11:42:54.784895 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Aug 10 11:42:54.784895 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Aug 10 11:42:54.784895 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Id: 1275e554301b4d019da34186581fc0da Aug 10 11:42:54.784895 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-AttachVolumeNegativeTest-1707340158 Aug 10 11:42:54.784895 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Role: member,reader Aug 10 11:42:54.784895 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Aug 10 11:42:54.786713 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1275e554301b4d019da34186581fc0da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1275e554301b4d019da34186581fc0da", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1275e554301b4d019da34186581fc0da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1275e554301b4d019da34186581fc0da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:42:54.786713 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-AttachVolumeNegativeTest-1707340158 Aug 10 11:42:54.786713 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant-Id: 1275e554301b4d019da34186581fc0da Aug 10 11:42:54.786713 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1707340158 Aug 10 11:42:54.786713 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User: tempest-AttachVolumeNegativeTest-1707340158-project Aug 10 11:42:54.786713 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Aug 10 11:42:54.786713 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Aug 10 11:42:54.786713 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Id: 4f61f9a578834243b0d11888c397deff Aug 10 11:42:54.786713 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-AttachVolumeNegativeTest-1707340158-project Aug 10 11:42:54.786713 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: method: > Aug 10 11:42:54.786713 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: exception: Instance 068eca04-664e-4a6e-b2cb-23b0b980c8f3 could not be found. Aug 10 11:42:54.786713 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: action_args: {'id': '068eca04-664e-4a6e-b2cb-23b0b980c8f3'} Aug 10 11:42:54.787664 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:42:54.787664 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:42:54.787664 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:42:54.787664 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:42:54.787664 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:42:54.787664 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:42:54.787664 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:42:54.787664 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:42:54.787664 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:42:54.787664 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:42:54.787664 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 068eca04-664e-4a6e-b2cb-23b0b980c8f3 could not be found. Aug 10 11:42:54.787664 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:42:54.787664 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:42:54.787664 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:42:54.787664 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:42:54.787664 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:42:54.787664 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:42:54.787664 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:42:54.787664 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:42:54.787664 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:42:54.789285 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:42:54.789285 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:42:54.789285 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:42:54.789285 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:42:54.789285 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:42:54.789285 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:42:54.789285 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:42:54.789285 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 068eca04-664e-4a6e-b2cb-23b0b980c8f3 could not be found. Aug 10 11:42:54.789285 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:42:54.789285 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:42:54.789285 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:42:54.789285 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:42:54.789285 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:42:54.789285 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:42:54.789285 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:42:54.789285 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:42:54.789285 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 068eca04-664e-4a6e-b2cb-23b0b980c8f3 could not be found. Aug 10 11:42:54.789285 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:42:54.790692 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-f8be932a-8ced-4f73-b4e1-041ce97972fe tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Returning 404 to user: Instance 068eca04-664e-4a6e-b2cb-23b0b980c8f3 could not be found. {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:42:54.790692 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-f8be932a-8ced-4f73-b4e1-041ce97972fe tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3" status: 404 len: 111 microversion: 2.1 time: 0.031325 Aug 10 11:42:54.790692 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 445/890] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:42:54 2022] GET /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:42:54.795221 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-bb71d597-41a4-4da4-90c1-63598535f87b tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '.version_select at 0x7fb7cdb12d30>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:42:54.903663 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-bb71d597-41a4-4da4-90c1-63598535f87b tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1736787440" status: 202 len: 0 microversion: 2.1 time: 0.112195 Aug 10 11:42:54.904203 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 446/891] 10.222.0.62 () {58 vars in 1221 bytes} [Wed Aug 10 11:42:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1736787440 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:42:55.913065 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-546ec3f9-38a8-45d8-90ba-8cc71150827f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Action: 'create', calling method: .version_select at 0x7fb7ce4c5700>, body: {"keypair": {"name": "tempest-keypair-773997084", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5FcMvOuqAgzgwauNftJgsSm8uClk7IjVUZ8fhkrJG28sRW/IhTwhmBoZcNgVnuUsIWgJXOJ1LlaxAHTyrx5KZfdTB3gZic6Yy8U6cmAuvljwadnV59xgF6vw2+4JXdfg=="}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:42:55.929249 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-546ec3f9-38a8-45d8-90ba-8cc71150827f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Getting quotas for project 1275e554301b4d019da34186581fc0da. Resources: {'key_pairs'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:42:55.933047 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-546ec3f9-38a8-45d8-90ba-8cc71150827f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Getting quotas for user 4f61f9a578834243b0d11888c397deff and project 1275e554301b4d019da34186581fc0da. Resources: {'key_pairs'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:42:56.012847 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-546ec3f9-38a8-45d8-90ba-8cc71150827f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.103590 Aug 10 11:42:56.013550 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 446/892] 10.222.0.62 () {60 vars in 1159 bytes} [Wed Aug 10 11:42:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:42:58.434109 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-87fa8948-f11e-48c2-a420-33a477e94414 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-139411637", "imageRef": "99bbc441-5102-4a51-a496-cfbffeb3033a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9e8c6f11-9bc0-4d49-baa5-ecd5d8e7ec5d"}], "security_groups": [{"name": "tempest-securitygroup--367931491"}], "key_name": "tempest-keypair-773997084", "user_data": "}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:42:58.540327 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.network.neutron [None req-87fa8948-f11e-48c2-a420-33a477e94414 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] validate_networks() for [('9e8c6f11-9bc0-4d49-baa5-ecd5d8e7ec5d', None, None, None, None, None)] {{(pid=124683) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:42:58.923302 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-87fa8948-f11e-48c2-a420-33a477e94414 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Flavor limits 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:42:58.923745 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-87fa8948-f11e-48c2-a420-33a477e94414 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Image limits 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:42:58.924259 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-87fa8948-f11e-48c2-a420-33a477e94414 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Flavor pref 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:42:58.924671 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-87fa8948-f11e-48c2-a420-33a477e94414 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Image pref 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:42:58.925083 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-87fa8948-f11e-48c2-a420-33a477e94414 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:42:58.933773 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-87fa8948-f11e-48c2-a420-33a477e94414 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:58.940433 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-87fa8948-f11e-48c2-a420-33a477e94414 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:58.940433 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-87fa8948-f11e-48c2-a420-33a477e94414 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:58.940433 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-87fa8948-f11e-48c2-a420-33a477e94414 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:58.940433 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-87fa8948-f11e-48c2-a420-33a477e94414 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:58.940846 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-87fa8948-f11e-48c2-a420-33a477e94414 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:58.953957 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-87fa8948-f11e-48c2-a420-33a477e94414 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Getting quotas for project 1275e554301b4d019da34186581fc0da. Resources: {'ram', 'instances', 'cores'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:42:58.957996 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-87fa8948-f11e-48c2-a420-33a477e94414 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Getting quotas for user 4f61f9a578834243b0d11888c397deff and project 1275e554301b4d019da34186581fc0da. Resources: {'ram', 'instances', 'cores'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:42:58.970047 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-87fa8948-f11e-48c2-a420-33a477e94414 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Going to run 1 instances... {{(pid=124683) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:42:58.972436 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-87fa8948-f11e-48c2-a420-33a477e94414 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: 556949a2-ac97-40b2-9827-ffa317d3c2a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99bbc441-5102-4a51-a496-cfbffeb3033a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124683) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:42:59.082825 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-87fa8948-f11e-48c2-a420-33a477e94414 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.653813 Aug 10 11:42:59.083461 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 447/893] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Aug 10 11:42:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 11:42:59.101886 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-5e26d9c3-d07e-49bc-9269-199cb7a16a72 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:42:59.102954 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-5e26d9c3-d07e-49bc-9269-199cb7a16a72 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: 556949a2-ac97-40b2-9827-ffa317d3c2a1] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:42:59.161287 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-5e26d9c3-d07e-49bc-9269-199cb7a16a72 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:42:59.168550 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-5e26d9c3-d07e-49bc-9269-199cb7a16a72 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/556949a2-ac97-40b2-9827-ffa317d3c2a1" status: 200 len: 1240 microversion: 2.1 time: 0.072520 Aug 10 11:42:59.169440 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 447/894] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:42:59 2022] GET /compute/v2.1/servers/556949a2-ac97-40b2-9827-ffa317d3c2a1 => generated 1240 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:43:00.190571 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-23882ca0-8275-44a2-9475-915c198bf3f4 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:43:00.191193 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-23882ca0-8275-44a2-9475-915c198bf3f4 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: 556949a2-ac97-40b2-9827-ffa317d3c2a1] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:43:00.198528 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-23882ca0-8275-44a2-9475-915c198bf3f4 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:00.199022 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-23882ca0-8275-44a2-9475-915c198bf3f4 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:00.199396 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-23882ca0-8275-44a2-9475-915c198bf3f4 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:00.200126 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-23882ca0-8275-44a2-9475-915c198bf3f4 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:00.200582 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-23882ca0-8275-44a2-9475-915c198bf3f4 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:00.201091 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-23882ca0-8275-44a2-9475-915c198bf3f4 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:00.262562 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-23882ca0-8275-44a2-9475-915c198bf3f4 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:43:00.271256 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-23882ca0-8275-44a2-9475-915c198bf3f4 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/556949a2-ac97-40b2-9827-ffa317d3c2a1" status: 200 len: 1236 microversion: 2.1 time: 0.085175 Aug 10 11:43:00.271821 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 448/895] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:43:00 2022] GET /compute/v2.1/servers/556949a2-ac97-40b2-9827-ffa317d3c2a1 => generated 1236 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:43:01.292304 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-7a3e3959-cdb1-459b-ab3f-58ff5850fa19 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:43:01.292851 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-7a3e3959-cdb1-459b-ab3f-58ff5850fa19 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: 556949a2-ac97-40b2-9827-ffa317d3c2a1] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:43:01.299886 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7a3e3959-cdb1-459b-ab3f-58ff5850fa19 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:01.300635 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7a3e3959-cdb1-459b-ab3f-58ff5850fa19 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:01.301069 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7a3e3959-cdb1-459b-ab3f-58ff5850fa19 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:01.301771 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7a3e3959-cdb1-459b-ab3f-58ff5850fa19 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:01.302227 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7a3e3959-cdb1-459b-ab3f-58ff5850fa19 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:01.302650 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7a3e3959-cdb1-459b-ab3f-58ff5850fa19 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:01.365289 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-7a3e3959-cdb1-459b-ab3f-58ff5850fa19 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:43:01.372615 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-7a3e3959-cdb1-459b-ab3f-58ff5850fa19 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/556949a2-ac97-40b2-9827-ffa317d3c2a1" status: 200 len: 1298 microversion: 2.1 time: 0.084379 Aug 10 11:43:01.373174 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 448/896] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:43:01 2022] GET /compute/v2.1/servers/556949a2-ac97-40b2-9827-ffa317d3c2a1 => generated 1298 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:43:02.395344 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-fb383339-6061-4f87-9470-ca418e030c1f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:43:02.395904 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-fb383339-6061-4f87-9470-ca418e030c1f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: 556949a2-ac97-40b2-9827-ffa317d3c2a1] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:43:02.402546 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fb383339-6061-4f87-9470-ca418e030c1f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:02.403061 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fb383339-6061-4f87-9470-ca418e030c1f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:02.403502 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fb383339-6061-4f87-9470-ca418e030c1f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:02.404227 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fb383339-6061-4f87-9470-ca418e030c1f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:02.404685 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fb383339-6061-4f87-9470-ca418e030c1f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:02.405116 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fb383339-6061-4f87-9470-ca418e030c1f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:02.501099 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-e9d6fe6e-567c-496e-acaa-6fb635dae043 req-d5dab68e-c578-4c56-967b-8abdf2ae1663 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "556949a2-ac97-40b2-9827-ffa317d3c2a1", "tag": "1828c28e-1b8e-4663-b048-5918944a0b41"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:43:02.514053 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-e9d6fe6e-567c-496e-acaa-6fb635dae043 req-d5dab68e-c578-4c56-967b-8abdf2ae1663 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:02.514755 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-e9d6fe6e-567c-496e-acaa-6fb635dae043 req-d5dab68e-c578-4c56-967b-8abdf2ae1663 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:02.515615 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-e9d6fe6e-567c-496e-acaa-6fb635dae043 req-d5dab68e-c578-4c56-967b-8abdf2ae1663 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:02.528298 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-e9d6fe6e-567c-496e-acaa-6fb635dae043 req-d5dab68e-c578-4c56-967b-8abdf2ae1663 service nova] Creating event network-changed:1828c28e-1b8e-4663-b048-5918944a0b41 for instance 556949a2-ac97-40b2-9827-ffa317d3c2a1 on hv-cinder-85272 Aug 10 11:43:02.533884 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-e9d6fe6e-567c-496e-acaa-6fb635dae043 req-d5dab68e-c578-4c56-967b-8abdf2ae1663 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039796 Aug 10 11:43:02.535269 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 449/897] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:43:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:43:02.631623 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-fb383339-6061-4f87-9470-ca418e030c1f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:43:02.639084 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-fb383339-6061-4f87-9470-ca418e030c1f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/556949a2-ac97-40b2-9827-ffa317d3c2a1" status: 200 len: 1365 microversion: 2.1 time: 0.248753 Aug 10 11:43:02.639663 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 449/898] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:43:02 2022] GET /compute/v2.1/servers/556949a2-ac97-40b2-9827-ffa317d3c2a1 => generated 1365 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:43:03.661780 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-c20454b9-4273-4a32-a7a9-a57f03b937a6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:43:03.662469 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-c20454b9-4273-4a32-a7a9-a57f03b937a6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: 556949a2-ac97-40b2-9827-ffa317d3c2a1] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:43:03.669000 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c20454b9-4273-4a32-a7a9-a57f03b937a6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:03.669481 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c20454b9-4273-4a32-a7a9-a57f03b937a6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:03.669907 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c20454b9-4273-4a32-a7a9-a57f03b937a6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:03.670581 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c20454b9-4273-4a32-a7a9-a57f03b937a6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:03.671029 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c20454b9-4273-4a32-a7a9-a57f03b937a6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:03.671451 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c20454b9-4273-4a32-a7a9-a57f03b937a6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:03.798331 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c20454b9-4273-4a32-a7a9-a57f03b937a6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:43:03.806632 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-c20454b9-4273-4a32-a7a9-a57f03b937a6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/556949a2-ac97-40b2-9827-ffa317d3c2a1" status: 200 len: 1365 microversion: 2.1 time: 0.149689 Aug 10 11:43:03.807183 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 450/899] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:43:03 2022] GET /compute/v2.1/servers/556949a2-ac97-40b2-9827-ffa317d3c2a1 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:43:04.827309 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-dc3768a9-56e4-4ebb-9dbe-fcd755fca944 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:43:04.827925 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-dc3768a9-56e4-4ebb-9dbe-fcd755fca944 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: 556949a2-ac97-40b2-9827-ffa317d3c2a1] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:43:04.834374 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-dc3768a9-56e4-4ebb-9dbe-fcd755fca944 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:04.834859 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-dc3768a9-56e4-4ebb-9dbe-fcd755fca944 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:04.835295 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-dc3768a9-56e4-4ebb-9dbe-fcd755fca944 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:04.836003 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-dc3768a9-56e4-4ebb-9dbe-fcd755fca944 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:04.836463 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-dc3768a9-56e4-4ebb-9dbe-fcd755fca944 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:04.836889 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-dc3768a9-56e4-4ebb-9dbe-fcd755fca944 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:04.965660 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-dc3768a9-56e4-4ebb-9dbe-fcd755fca944 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:43:04.973111 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-dc3768a9-56e4-4ebb-9dbe-fcd755fca944 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/556949a2-ac97-40b2-9827-ffa317d3c2a1" status: 200 len: 1365 microversion: 2.1 time: 0.149664 Aug 10 11:43:04.973671 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 450/900] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:43:04 2022] GET /compute/v2.1/servers/556949a2-ac97-40b2-9827-ffa317d3c2a1 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:43:05.994380 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-d0f5ffa9-ff36-4a60-a82a-3a5a30ff8e90 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:43:05.995596 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-d0f5ffa9-ff36-4a60-a82a-3a5a30ff8e90 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: 556949a2-ac97-40b2-9827-ffa317d3c2a1] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:43:06.004636 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d0f5ffa9-ff36-4a60-a82a-3a5a30ff8e90 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:06.005436 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d0f5ffa9-ff36-4a60-a82a-3a5a30ff8e90 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:06.005872 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d0f5ffa9-ff36-4a60-a82a-3a5a30ff8e90 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:06.006823 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d0f5ffa9-ff36-4a60-a82a-3a5a30ff8e90 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:06.007276 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d0f5ffa9-ff36-4a60-a82a-3a5a30ff8e90 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:06.007704 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d0f5ffa9-ff36-4a60-a82a-3a5a30ff8e90 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:06.147313 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-d0f5ffa9-ff36-4a60-a82a-3a5a30ff8e90 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:43:06.154787 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-d0f5ffa9-ff36-4a60-a82a-3a5a30ff8e90 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/556949a2-ac97-40b2-9827-ffa317d3c2a1" status: 200 len: 1365 microversion: 2.1 time: 0.164318 Aug 10 11:43:06.155350 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 451/901] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:43:05 2022] GET /compute/v2.1/servers/556949a2-ac97-40b2-9827-ffa317d3c2a1 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:43:06.373515 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-39f9dbf9-62ac-4551-8189-ba9fe4e0ef76 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:43:06.374050 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-39f9dbf9-62ac-4551-8189-ba9fe4e0ef76 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: e014e560-1308-466b-9b93-725098e79f2d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:43:06.376421 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-8b0108b9-eedc-4432-a663-c94cb7a025e1 req-22c06c23-88c7-4788-bd62-7baf49facbbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e014e560-1308-466b-9b93-725098e79f2d", "tag": "7f280e4b-4e93-4664-bfaf-0861417f39b6"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:43:06.381465 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-39f9dbf9-62ac-4551-8189-ba9fe4e0ef76 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:06.382175 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-39f9dbf9-62ac-4551-8189-ba9fe4e0ef76 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:06.382677 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-39f9dbf9-62ac-4551-8189-ba9fe4e0ef76 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:06.383711 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-39f9dbf9-62ac-4551-8189-ba9fe4e0ef76 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:06.384205 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-39f9dbf9-62ac-4551-8189-ba9fe4e0ef76 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:06.384642 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-39f9dbf9-62ac-4551-8189-ba9fe4e0ef76 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:06.386633 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-8b0108b9-eedc-4432-a663-c94cb7a025e1 req-22c06c23-88c7-4788-bd62-7baf49facbbf service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:06.387191 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-8b0108b9-eedc-4432-a663-c94cb7a025e1 req-22c06c23-88c7-4788-bd62-7baf49facbbf service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:06.387727 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-8b0108b9-eedc-4432-a663-c94cb7a025e1 req-22c06c23-88c7-4788-bd62-7baf49facbbf service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:06.398793 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-8b0108b9-eedc-4432-a663-c94cb7a025e1 req-22c06c23-88c7-4788-bd62-7baf49facbbf service nova] Creating event network-changed:7f280e4b-4e93-4664-bfaf-0861417f39b6 for instance e014e560-1308-466b-9b93-725098e79f2d on hv-cinder-85272 Aug 10 11:43:06.403641 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-8b0108b9-eedc-4432-a663-c94cb7a025e1 req-22c06c23-88c7-4788-bd62-7baf49facbbf service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031013 Aug 10 11:43:06.404579 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 452/902] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:43:06.411540 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-39f9dbf9-62ac-4551-8189-ba9fe4e0ef76 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: e014e560-1308-466b-9b93-725098e79f2d] Going to try to terminate instance {{(pid=124683) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:43:06.709036 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-39f9dbf9-62ac-4551-8189-ba9fe4e0ef76 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "DELETE /compute/v2.1/servers/e014e560-1308-466b-9b93-725098e79f2d" status: 204 len: 0 microversion: 2.1 time: 0.339027 Aug 10 11:43:06.710517 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 451/903] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 10 11:43:06 2022] DELETE /compute/v2.1/servers/e014e560-1308-466b-9b93-725098e79f2d => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:43:06.719287 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-ccc47f89-8b66-42cf-83a2-11eb0e41960a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:43:06.720017 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-ccc47f89-8b66-42cf-83a2-11eb0e41960a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: e014e560-1308-466b-9b93-725098e79f2d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:43:06.726249 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ccc47f89-8b66-42cf-83a2-11eb0e41960a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:06.726725 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ccc47f89-8b66-42cf-83a2-11eb0e41960a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:06.727303 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ccc47f89-8b66-42cf-83a2-11eb0e41960a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:06.727863 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ccc47f89-8b66-42cf-83a2-11eb0e41960a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:06.728343 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ccc47f89-8b66-42cf-83a2-11eb0e41960a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:06.728773 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ccc47f89-8b66-42cf-83a2-11eb0e41960a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:06.860459 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-ccc47f89-8b66-42cf-83a2-11eb0e41960a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:43:06.868185 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-ccc47f89-8b66-42cf-83a2-11eb0e41960a tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/e014e560-1308-466b-9b93-725098e79f2d" status: 200 len: 1579 microversion: 2.1 time: 0.153067 Aug 10 11:43:06.868748 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 453/904] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:43:06 2022] GET /compute/v2.1/servers/e014e560-1308-466b-9b93-725098e79f2d => generated 1579 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:43:07.176382 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-088eb233-6b62-4d92-b0c1-7e66c3432937 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:43:07.177090 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-088eb233-6b62-4d92-b0c1-7e66c3432937 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: 556949a2-ac97-40b2-9827-ffa317d3c2a1] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:43:07.187015 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-088eb233-6b62-4d92-b0c1-7e66c3432937 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:07.187529 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-088eb233-6b62-4d92-b0c1-7e66c3432937 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:07.187993 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-088eb233-6b62-4d92-b0c1-7e66c3432937 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:07.188679 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-088eb233-6b62-4d92-b0c1-7e66c3432937 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:07.189127 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-088eb233-6b62-4d92-b0c1-7e66c3432937 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:07.189548 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-088eb233-6b62-4d92-b0c1-7e66c3432937 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:07.587057 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-088eb233-6b62-4d92-b0c1-7e66c3432937 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:43:07.595168 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-088eb233-6b62-4d92-b0c1-7e66c3432937 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/556949a2-ac97-40b2-9827-ffa317d3c2a1" status: 200 len: 1365 microversion: 2.1 time: 0.424023 Aug 10 11:43:07.595738 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 452/905] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:43:07 2022] GET /compute/v2.1/servers/556949a2-ac97-40b2-9827-ffa317d3c2a1 => generated 1365 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:43:07.677657 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-5ad3c6ca-168d-4277-aa67-9a9feb80e92d req-280a210a-b88c-4d13-ad08-feba8f17df4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "556949a2-ac97-40b2-9827-ffa317d3c2a1", "name": "network-vif-plugged", "status": "completed", "tag": "1828c28e-1b8e-4663-b048-5918944a0b41"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:43:07.687316 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-5ad3c6ca-168d-4277-aa67-9a9feb80e92d req-280a210a-b88c-4d13-ad08-feba8f17df4e service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:07.687787 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-5ad3c6ca-168d-4277-aa67-9a9feb80e92d req-280a210a-b88c-4d13-ad08-feba8f17df4e service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:07.688363 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-5ad3c6ca-168d-4277-aa67-9a9feb80e92d req-280a210a-b88c-4d13-ad08-feba8f17df4e service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:07.699287 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-5ad3c6ca-168d-4277-aa67-9a9feb80e92d req-280a210a-b88c-4d13-ad08-feba8f17df4e service nova] Creating event network-vif-plugged:1828c28e-1b8e-4663-b048-5918944a0b41 for instance 556949a2-ac97-40b2-9827-ffa317d3c2a1 on hv-cinder-85272 Aug 10 11:43:07.704660 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-5ad3c6ca-168d-4277-aa67-9a9feb80e92d req-280a210a-b88c-4d13-ad08-feba8f17df4e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032450 Aug 10 11:43:07.705683 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 454/906] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:43:07.889729 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-3e6aaf97-2e4d-4253-b13e-6d22908a2b36 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:43:07.890636 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-3e6aaf97-2e4d-4253-b13e-6d22908a2b36 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: e014e560-1308-466b-9b93-725098e79f2d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:43:07.897836 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3e6aaf97-2e4d-4253-b13e-6d22908a2b36 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:07.902963 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3e6aaf97-2e4d-4253-b13e-6d22908a2b36 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:07.902963 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3e6aaf97-2e4d-4253-b13e-6d22908a2b36 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:07.902963 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3e6aaf97-2e4d-4253-b13e-6d22908a2b36 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:07.902963 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3e6aaf97-2e4d-4253-b13e-6d22908a2b36 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:07.903355 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3e6aaf97-2e4d-4253-b13e-6d22908a2b36 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:08.057100 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-3e6aaf97-2e4d-4253-b13e-6d22908a2b36 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:43:08.064609 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-3e6aaf97-2e4d-4253-b13e-6d22908a2b36 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/e014e560-1308-466b-9b93-725098e79f2d" status: 200 len: 1579 microversion: 2.1 time: 0.178917 Aug 10 11:43:08.065260 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 453/907] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:43:07 2022] GET /compute/v2.1/servers/e014e560-1308-466b-9b93-725098e79f2d => generated 1579 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:43:08.616662 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-107df77e-07fd-47f8-97b5-779353f109aa tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:43:08.617385 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-107df77e-07fd-47f8-97b5-779353f109aa tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: 556949a2-ac97-40b2-9827-ffa317d3c2a1] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:43:08.623518 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-107df77e-07fd-47f8-97b5-779353f109aa tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:08.624030 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-107df77e-07fd-47f8-97b5-779353f109aa tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:08.624473 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-107df77e-07fd-47f8-97b5-779353f109aa tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:08.625157 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-107df77e-07fd-47f8-97b5-779353f109aa tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:08.625606 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-107df77e-07fd-47f8-97b5-779353f109aa tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:08.626077 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-107df77e-07fd-47f8-97b5-779353f109aa tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:08.790156 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-107df77e-07fd-47f8-97b5-779353f109aa tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:43:08.797566 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-107df77e-07fd-47f8-97b5-779353f109aa tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/556949a2-ac97-40b2-9827-ffa317d3c2a1" status: 200 len: 1365 microversion: 2.1 time: 0.186211 Aug 10 11:43:08.798293 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 455/908] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:43:08 2022] GET /compute/v2.1/servers/556949a2-ac97-40b2-9827-ffa317d3c2a1 => generated 1365 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:43:08.895872 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-5d3bcef2-24e5-4241-ac29-f82a8da1c65e req-5eeeae8b-201d-48ad-b6ba-ece0fbe81f70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e014e560-1308-466b-9b93-725098e79f2d", "name": "network-vif-deleted", "tag": "7f280e4b-4e93-4664-bfaf-0861417f39b6"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:43:08.905863 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-5d3bcef2-24e5-4241-ac29-f82a8da1c65e req-5eeeae8b-201d-48ad-b6ba-ece0fbe81f70 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:08.907043 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-5d3bcef2-24e5-4241-ac29-f82a8da1c65e req-5eeeae8b-201d-48ad-b6ba-ece0fbe81f70 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:08.907043 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-5d3bcef2-24e5-4241-ac29-f82a8da1c65e req-5eeeae8b-201d-48ad-b6ba-ece0fbe81f70 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:08.918889 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-5d3bcef2-24e5-4241-ac29-f82a8da1c65e req-5eeeae8b-201d-48ad-b6ba-ece0fbe81f70 service nova] Creating event network-vif-deleted:7f280e4b-4e93-4664-bfaf-0861417f39b6 for instance e014e560-1308-466b-9b93-725098e79f2d on hv-cinder-85272 Aug 10 11:43:08.923638 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-5d3bcef2-24e5-4241-ac29-f82a8da1c65e req-5eeeae8b-201d-48ad-b6ba-ece0fbe81f70 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031687 Aug 10 11:43:08.924839 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 454/909] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:43:09.085574 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-baa87339-053f-4060-9872-9b9d271985e5 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:43:09.086159 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-baa87339-053f-4060-9872-9b9d271985e5 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: e014e560-1308-466b-9b93-725098e79f2d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:43:09.092079 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-baa87339-053f-4060-9872-9b9d271985e5 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:09.092565 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-baa87339-053f-4060-9872-9b9d271985e5 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:09.093004 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-baa87339-053f-4060-9872-9b9d271985e5 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:09.093692 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-baa87339-053f-4060-9872-9b9d271985e5 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:09.094153 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-baa87339-053f-4060-9872-9b9d271985e5 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:09.094583 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-baa87339-053f-4060-9872-9b9d271985e5 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:09.158134 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-baa87339-053f-4060-9872-9b9d271985e5 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:43:09.165598 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=6 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:43:09.168273 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-baa87339-053f-4060-9872-9b9d271985e5 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/e014e560-1308-466b-9b93-725098e79f2d" status: 200 len: 1225 microversion: 2.1 time: 0.086705 Aug 10 11:43:09.169071 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 456/910] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:43:09 2022] GET /compute/v2.1/servers/e014e560-1308-466b-9b93-725098e79f2d => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:43:09.821947 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-72d5d105-69cc-4fac-bb18-39b87fbd79bb tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:43:09.822649 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-72d5d105-69cc-4fac-bb18-39b87fbd79bb tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: 556949a2-ac97-40b2-9827-ffa317d3c2a1] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:43:09.824666 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=2 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:43:09.829044 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=6 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:43:09.830294 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-72d5d105-69cc-4fac-bb18-39b87fbd79bb tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:09.831040 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-72d5d105-69cc-4fac-bb18-39b87fbd79bb tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:09.831579 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-72d5d105-69cc-4fac-bb18-39b87fbd79bb tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:09.832307 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-72d5d105-69cc-4fac-bb18-39b87fbd79bb tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:09.832763 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-72d5d105-69cc-4fac-bb18-39b87fbd79bb tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:09.833201 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-72d5d105-69cc-4fac-bb18-39b87fbd79bb tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:09.962225 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-72d5d105-69cc-4fac-bb18-39b87fbd79bb tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:43:09.965980 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:43:09.970320 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-72d5d105-69cc-4fac-bb18-39b87fbd79bb tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/556949a2-ac97-40b2-9827-ffa317d3c2a1" status: 200 len: 1556 microversion: 2.1 time: 0.153552 Aug 10 11:43:09.971395 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 455/911] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:43:09 2022] GET /compute/v2.1/servers/556949a2-ac97-40b2-9827-ffa317d3c2a1 => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:43:09.992387 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-d2114863-77cc-49db-b4fe-ecc7ec5cc8e9 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:43:09.992988 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-d2114863-77cc-49db-b4fe-ecc7ec5cc8e9 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: 556949a2-ac97-40b2-9827-ffa317d3c2a1] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:43:09.999573 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d2114863-77cc-49db-b4fe-ecc7ec5cc8e9 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:10.000100 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d2114863-77cc-49db-b4fe-ecc7ec5cc8e9 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:10.000543 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d2114863-77cc-49db-b4fe-ecc7ec5cc8e9 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:10.001231 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d2114863-77cc-49db-b4fe-ecc7ec5cc8e9 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:10.001692 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d2114863-77cc-49db-b4fe-ecc7ec5cc8e9 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:10.002117 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d2114863-77cc-49db-b4fe-ecc7ec5cc8e9 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:10.084117 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-d2114863-77cc-49db-b4fe-ecc7ec5cc8e9 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/556949a2-ac97-40b2-9827-ffa317d3c2a1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095877 Aug 10 11:43:10.084734 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 457/912] 10.222.0.62 () {58 vars in 1275 bytes} [Wed Aug 10 11:43:09 2022] GET /compute/v2.1/servers/556949a2-ac97-40b2-9827-ffa317d3c2a1/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:43:10.190655 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-5bd5df1e-dd3b-4adb-b01b-4ab6f3f0e161 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:43:10.191300 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-5bd5df1e-dd3b-4adb-b01b-4ab6f3f0e161 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: e014e560-1308-466b-9b93-725098e79f2d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:43:10.198171 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5bd5df1e-dd3b-4adb-b01b-4ab6f3f0e161 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:10.199490 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5bd5df1e-dd3b-4adb-b01b-4ab6f3f0e161 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:10.199939 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5bd5df1e-dd3b-4adb-b01b-4ab6f3f0e161 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:10.205806 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5bd5df1e-dd3b-4adb-b01b-4ab6f3f0e161 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:10.205806 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5bd5df1e-dd3b-4adb-b01b-4ab6f3f0e161 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:10.205806 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5bd5df1e-dd3b-4adb-b01b-4ab6f3f0e161 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:10.237398 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5bd5df1e-dd3b-4adb-b01b-4ab6f3f0e161 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:10.237891 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5bd5df1e-dd3b-4adb-b01b-4ab6f3f0e161 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:10.238273 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5bd5df1e-dd3b-4adb-b01b-4ab6f3f0e161 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:10.238725 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.objects.instance [None req-5bd5df1e-dd3b-4adb-b01b-4ab6f3f0e161 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lazy-loading 'fault' on Instance uuid e014e560-1308-466b-9b93-725098e79f2d {{(pid=124683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:43:10.287352 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-5bd5df1e-dd3b-4adb-b01b-4ab6f3f0e161 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:43:10.295682 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-5bd5df1e-dd3b-4adb-b01b-4ab6f3f0e161 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/e014e560-1308-466b-9b93-725098e79f2d" status: 200 len: 1230 microversion: 2.1 time: 0.109149 Aug 10 11:43:10.296495 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 456/913] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:43:10 2022] GET /compute/v2.1/servers/e014e560-1308-466b-9b93-725098e79f2d => generated 1230 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:43:11.313743 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-bee78862-c71d-4aa0-977b-fe44fd03fd65 req-467fd6b6-8286-4d1c-8adc-bb5d23acec35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "556949a2-ac97-40b2-9827-ffa317d3c2a1", "tag": "1828c28e-1b8e-4663-b048-5918944a0b41"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:43:11.316954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-9941215e-41a2-4f7e-ae47-0d743cead4cd tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:43:11.317717 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-9941215e-41a2-4f7e-ae47-0d743cead4cd tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: e014e560-1308-466b-9b93-725098e79f2d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:43:11.318686 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:43:11.324132 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-bee78862-c71d-4aa0-977b-fe44fd03fd65 req-467fd6b6-8286-4d1c-8adc-bb5d23acec35 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:11.324702 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-bee78862-c71d-4aa0-977b-fe44fd03fd65 req-467fd6b6-8286-4d1c-8adc-bb5d23acec35 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:11.324842 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9941215e-41a2-4f7e-ae47-0d743cead4cd tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:11.325277 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9941215e-41a2-4f7e-ae47-0d743cead4cd tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:11.325720 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9941215e-41a2-4f7e-ae47-0d743cead4cd tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:11.325936 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-bee78862-c71d-4aa0-977b-fe44fd03fd65 req-467fd6b6-8286-4d1c-8adc-bb5d23acec35 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:11.326419 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9941215e-41a2-4f7e-ae47-0d743cead4cd tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:11.326914 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9941215e-41a2-4f7e-ae47-0d743cead4cd tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:11.327677 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9941215e-41a2-4f7e-ae47-0d743cead4cd tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:11.330272 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:43:11.338522 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-bee78862-c71d-4aa0-977b-fe44fd03fd65 req-467fd6b6-8286-4d1c-8adc-bb5d23acec35 service nova] Creating event network-changed:1828c28e-1b8e-4663-b048-5918944a0b41 for instance 556949a2-ac97-40b2-9827-ffa317d3c2a1 on hv-cinder-85272 Aug 10 11:43:11.342913 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-9941215e-41a2-4f7e-ae47-0d743cead4cd tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] HTTP exception thrown: Instance e014e560-1308-466b-9b93-725098e79f2d could not be found. Aug 10 11:43:11.343574 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-bee78862-c71d-4aa0-977b-fe44fd03fd65 req-467fd6b6-8286-4d1c-8adc-bb5d23acec35 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034014 Aug 10 11:43:11.344599 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 458/914] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:43:11.348015 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-9941215e-41a2-4f7e-ae47-0d743cead4cd tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Request method failure captured: Aug 10 11:43:11.348015 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: request: GET /compute/v2.1/servers/e014e560-1308-466b-9b93-725098e79f2d HTTP/1.1 Aug 10 11:43:11.348015 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept: application/json Aug 10 11:43:11.348015 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Aug 10 11:43:11.348015 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Connection: close Aug 10 11:43:11.348015 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Length: 0 Aug 10 11:43:11.348015 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Type: application/json Aug 10 11:43:11.348015 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Host: 10.222.0.62 Aug 10 11:43:11.348015 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Aug 10 11:43:11.348015 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.11 Aug 10 11:43:11.348015 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABi85gTsVtOigC__4GPwavS26SrwsqOH5ANgJJiPHSnmoCdCFlO7Vv0aBh05d4R9g2_M6UNx2hiNfTLZMacfAkeEGchE5_8fTQkP7MDbQDxP9RuWPJOYKVIFLm5not1Hcvns6F-kn4NACae59sRkBuf232itUJbqeNgXSPZetV0wqsoemo Aug 10 11:43:11.348015 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Aug 10 11:43:11.348015 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Aug 10 11:43:11.348015 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Aug 10 11:43:11.348015 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Aug 10 11:43:11.348015 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Aug 10 11:43:11.348015 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Aug 10 11:43:11.348015 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Id: 1c9f7b60a16e438a89c4f7248707ae2d Aug 10 11:43:11.348015 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-TestVolumeBootPattern-195522797 Aug 10 11:43:11.348015 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Role: member,reader Aug 10 11:43:11.348015 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Aug 10 11:43:11.349756 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1c9f7b60a16e438a89c4f7248707ae2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1c9f7b60a16e438a89c4f7248707ae2d", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1c9f7b60a16e438a89c4f7248707ae2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1c9f7b60a16e438a89c4f7248707ae2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:43:11.349756 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-TestVolumeBootPattern-195522797 Aug 10 11:43:11.349756 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Id: 1c9f7b60a16e438a89c4f7248707ae2d Aug 10 11:43:11.349756 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-TestVolumeBootPattern-195522797 Aug 10 11:43:11.349756 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User: tempest-TestVolumeBootPattern-195522797-project Aug 10 11:43:11.349756 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Aug 10 11:43:11.349756 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Aug 10 11:43:11.349756 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Id: 83d48f0f35644f23a0fc2216e5ec5a2c Aug 10 11:43:11.349756 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-TestVolumeBootPattern-195522797-project Aug 10 11:43:11.349756 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: method: > Aug 10 11:43:11.349756 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: exception: Instance e014e560-1308-466b-9b93-725098e79f2d could not be found. Aug 10 11:43:11.349756 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: action_args: {'id': 'e014e560-1308-466b-9b93-725098e79f2d'} Aug 10 11:43:11.350644 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:43:11.350644 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:43:11.350644 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:43:11.350644 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:43:11.350644 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:43:11.350644 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:43:11.350644 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:43:11.350644 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:43:11.350644 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:43:11.350644 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:43:11.350644 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e014e560-1308-466b-9b93-725098e79f2d could not be found. Aug 10 11:43:11.350644 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:43:11.350644 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:43:11.350644 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:43:11.350644 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:43:11.350644 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:43:11.350644 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:43:11.350644 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:43:11.350644 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:43:11.350644 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:43:11.352306 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:43:11.352306 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:43:11.352306 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:43:11.352306 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:43:11.352306 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:43:11.352306 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:43:11.352306 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:43:11.352306 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e014e560-1308-466b-9b93-725098e79f2d could not be found. Aug 10 11:43:11.352306 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:43:11.352306 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:43:11.352306 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:43:11.352306 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:43:11.352306 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:43:11.352306 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:43:11.352306 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:43:11.352306 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:43:11.352306 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e014e560-1308-466b-9b93-725098e79f2d could not be found. Aug 10 11:43:11.352306 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:43:11.353976 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-9941215e-41a2-4f7e-ae47-0d743cead4cd tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Returning 404 to user: Instance e014e560-1308-466b-9b93-725098e79f2d could not be found. {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:43:11.353976 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-9941215e-41a2-4f7e-ae47-0d743cead4cd tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/e014e560-1308-466b-9b93-725098e79f2d" status: 404 len: 111 microversion: 2.1 time: 0.036697 Aug 10 11:43:11.354400 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 457/915] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:43:11 2022] GET /compute/v2.1/servers/e014e560-1308-466b-9b93-725098e79f2d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 11:43:14.715375 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-d186bc26-6806-48dc-b2a8-c189d39e3e20 req-10e61ed7-d3fa-4174-8ec6-61a4e69fc89c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c07ab9eb-c1e1-4751-be52-6af1da8790e5", "tag": "49f146b4-6b29-4027-95c8-23b108907bed"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:43:14.718055 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-5d91ccdd-d659-47d9-acf3-c1eec72670a2 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:43:14.726859 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-5d91ccdd-d659-47d9-acf3-c1eec72670a2 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: c07ab9eb-c1e1-4751-be52-6af1da8790e5] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:43:14.735257 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5d91ccdd-d659-47d9-acf3-c1eec72670a2 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:14.737943 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-d186bc26-6806-48dc-b2a8-c189d39e3e20 req-10e61ed7-d3fa-4174-8ec6-61a4e69fc89c service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:14.738475 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5d91ccdd-d659-47d9-acf3-c1eec72670a2 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:14.739108 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5d91ccdd-d659-47d9-acf3-c1eec72670a2 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:14.739814 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-d186bc26-6806-48dc-b2a8-c189d39e3e20 req-10e61ed7-d3fa-4174-8ec6-61a4e69fc89c service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:14.740623 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5d91ccdd-d659-47d9-acf3-c1eec72670a2 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:14.741115 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-d186bc26-6806-48dc-b2a8-c189d39e3e20 req-10e61ed7-d3fa-4174-8ec6-61a4e69fc89c service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:14.741606 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5d91ccdd-d659-47d9-acf3-c1eec72670a2 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:14.745594 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5d91ccdd-d659-47d9-acf3-c1eec72670a2 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:14.753512 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-d186bc26-6806-48dc-b2a8-c189d39e3e20 req-10e61ed7-d3fa-4174-8ec6-61a4e69fc89c service nova] Creating event network-changed:49f146b4-6b29-4027-95c8-23b108907bed for instance c07ab9eb-c1e1-4751-be52-6af1da8790e5 on hv-cinder-85272 Aug 10 11:43:14.758856 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-d186bc26-6806-48dc-b2a8-c189d39e3e20 req-10e61ed7-d3fa-4174-8ec6-61a4e69fc89c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048461 Aug 10 11:43:14.759807 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 458/916] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:43:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:43:14.773969 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-5d91ccdd-d659-47d9-acf3-c1eec72670a2 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: c07ab9eb-c1e1-4751-be52-6af1da8790e5] Going to try to terminate instance {{(pid=124682) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:43:15.091368 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-5d91ccdd-d659-47d9-acf3-c1eec72670a2 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c07ab9eb-c1e1-4751-be52-6af1da8790e5" status: 204 len: 0 microversion: 2.1 time: 0.383572 Aug 10 11:43:15.093580 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 459/917] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 10 11:43:14 2022] DELETE /compute/v2.1/servers/c07ab9eb-c1e1-4751-be52-6af1da8790e5 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:43:15.101691 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-b3282496-e302-4c94-aee5-0680be15a662 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:43:15.102402 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-b3282496-e302-4c94-aee5-0680be15a662 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: c07ab9eb-c1e1-4751-be52-6af1da8790e5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:43:15.109204 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b3282496-e302-4c94-aee5-0680be15a662 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:15.109747 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b3282496-e302-4c94-aee5-0680be15a662 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:15.110191 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b3282496-e302-4c94-aee5-0680be15a662 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:15.110885 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b3282496-e302-4c94-aee5-0680be15a662 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:15.111436 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b3282496-e302-4c94-aee5-0680be15a662 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:15.112144 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b3282496-e302-4c94-aee5-0680be15a662 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:15.255849 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-b3282496-e302-4c94-aee5-0680be15a662 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:43:15.263640 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-b3282496-e302-4c94-aee5-0680be15a662 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/c07ab9eb-c1e1-4751-be52-6af1da8790e5" status: 200 len: 1578 microversion: 2.1 time: 0.166662 Aug 10 11:43:15.264344 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 459/918] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:43:15 2022] GET /compute/v2.1/servers/c07ab9eb-c1e1-4751-be52-6af1da8790e5 => generated 1578 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:43:16.287304 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-1fea5799-9263-45a6-b89d-096b78dd59d2 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:43:16.288042 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-1fea5799-9263-45a6-b89d-096b78dd59d2 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: c07ab9eb-c1e1-4751-be52-6af1da8790e5] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:43:16.294491 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1fea5799-9263-45a6-b89d-096b78dd59d2 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:16.294977 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1fea5799-9263-45a6-b89d-096b78dd59d2 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:16.295415 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1fea5799-9263-45a6-b89d-096b78dd59d2 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:16.296131 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1fea5799-9263-45a6-b89d-096b78dd59d2 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:16.296592 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1fea5799-9263-45a6-b89d-096b78dd59d2 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:16.297016 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1fea5799-9263-45a6-b89d-096b78dd59d2 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:16.430258 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-1fea5799-9263-45a6-b89d-096b78dd59d2 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:43:16.438247 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-1fea5799-9263-45a6-b89d-096b78dd59d2 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/c07ab9eb-c1e1-4751-be52-6af1da8790e5" status: 200 len: 1578 microversion: 2.1 time: 0.155213 Aug 10 11:43:16.438750 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 460/919] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:43:16 2022] GET /compute/v2.1/servers/c07ab9eb-c1e1-4751-be52-6af1da8790e5 => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:43:17.135164 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-7627563e-7cd6-4809-82c2-b2675cb7bd63 req-881af663-6438-4b7f-8e24-844a21712314 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c07ab9eb-c1e1-4751-be52-6af1da8790e5", "name": "network-vif-deleted", "tag": "49f146b4-6b29-4027-95c8-23b108907bed"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:43:17.145572 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-7627563e-7cd6-4809-82c2-b2675cb7bd63 req-881af663-6438-4b7f-8e24-844a21712314 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:17.146057 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-7627563e-7cd6-4809-82c2-b2675cb7bd63 req-881af663-6438-4b7f-8e24-844a21712314 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:17.146501 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-7627563e-7cd6-4809-82c2-b2675cb7bd63 req-881af663-6438-4b7f-8e24-844a21712314 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:17.157228 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-7627563e-7cd6-4809-82c2-b2675cb7bd63 req-881af663-6438-4b7f-8e24-844a21712314 service nova] Creating event network-vif-deleted:49f146b4-6b29-4027-95c8-23b108907bed for instance c07ab9eb-c1e1-4751-be52-6af1da8790e5 on hv-cinder-85272 Aug 10 11:43:17.162677 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-7627563e-7cd6-4809-82c2-b2675cb7bd63 req-881af663-6438-4b7f-8e24-844a21712314 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031252 Aug 10 11:43:17.163245 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 460/920] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:43:17.462678 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-51291c54-ba89-492f-b2bf-934e52a15722 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:43:17.472380 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-51291c54-ba89-492f-b2bf-934e52a15722 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: c07ab9eb-c1e1-4751-be52-6af1da8790e5] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:43:17.472380 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-51291c54-ba89-492f-b2bf-934e52a15722 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:17.472380 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-51291c54-ba89-492f-b2bf-934e52a15722 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:17.472380 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-51291c54-ba89-492f-b2bf-934e52a15722 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:17.472788 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-51291c54-ba89-492f-b2bf-934e52a15722 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:17.472788 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-51291c54-ba89-492f-b2bf-934e52a15722 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:17.472788 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-51291c54-ba89-492f-b2bf-934e52a15722 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:17.539529 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-51291c54-ba89-492f-b2bf-934e52a15722 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d48f0f35644f23a0fc2216e5ec5a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9f7b60a16e438a89c4f7248707ae2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:43:17.548225 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-51291c54-ba89-492f-b2bf-934e52a15722 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/c07ab9eb-c1e1-4751-be52-6af1da8790e5" status: 200 len: 1226 microversion: 2.1 time: 0.090531 Aug 10 11:43:17.548702 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 461/921] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:43:17 2022] GET /compute/v2.1/servers/c07ab9eb-c1e1-4751-be52-6af1da8790e5 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:43:18.571279 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-7b94caed-68c9-4394-b733-9a005255dde9 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:43:18.571893 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-7b94caed-68c9-4394-b733-9a005255dde9 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: c07ab9eb-c1e1-4751-be52-6af1da8790e5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:43:18.578011 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7b94caed-68c9-4394-b733-9a005255dde9 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:18.578487 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7b94caed-68c9-4394-b733-9a005255dde9 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:18.578922 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7b94caed-68c9-4394-b733-9a005255dde9 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:18.579627 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7b94caed-68c9-4394-b733-9a005255dde9 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:18.580110 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7b94caed-68c9-4394-b733-9a005255dde9 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:18.580535 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7b94caed-68c9-4394-b733-9a005255dde9 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:18.593681 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-7b94caed-68c9-4394-b733-9a005255dde9 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] HTTP exception thrown: Instance c07ab9eb-c1e1-4751-be52-6af1da8790e5 could not be found. Aug 10 11:43:18.595561 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-7b94caed-68c9-4394-b733-9a005255dde9 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Request method failure captured: Aug 10 11:43:18.595561 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: request: GET /compute/v2.1/servers/c07ab9eb-c1e1-4751-be52-6af1da8790e5 HTTP/1.1 Aug 10 11:43:18.595561 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept: application/json Aug 10 11:43:18.595561 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Aug 10 11:43:18.595561 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Connection: close Aug 10 11:43:18.595561 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Length: 0 Aug 10 11:43:18.595561 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Type: application/json Aug 10 11:43:18.595561 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Host: 10.222.0.62 Aug 10 11:43:18.595561 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Aug 10 11:43:18.595561 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.11 Aug 10 11:43:18.595561 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABi85gTsVtOigC__4GPwavS26SrwsqOH5ANgJJiPHSnmoCdCFlO7Vv0aBh05d4R9g2_M6UNx2hiNfTLZMacfAkeEGchE5_8fTQkP7MDbQDxP9RuWPJOYKVIFLm5not1Hcvns6F-kn4NACae59sRkBuf232itUJbqeNgXSPZetV0wqsoemo Aug 10 11:43:18.595561 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Aug 10 11:43:18.595561 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Aug 10 11:43:18.595561 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Aug 10 11:43:18.595561 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Aug 10 11:43:18.595561 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Aug 10 11:43:18.595561 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Aug 10 11:43:18.595561 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Id: 1c9f7b60a16e438a89c4f7248707ae2d Aug 10 11:43:18.595561 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-TestVolumeBootPattern-195522797 Aug 10 11:43:18.595561 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Role: member,reader Aug 10 11:43:18.595561 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Aug 10 11:43:18.597230 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1c9f7b60a16e438a89c4f7248707ae2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1c9f7b60a16e438a89c4f7248707ae2d", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1c9f7b60a16e438a89c4f7248707ae2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1c9f7b60a16e438a89c4f7248707ae2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:43:18.597230 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-TestVolumeBootPattern-195522797 Aug 10 11:43:18.597230 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Id: 1c9f7b60a16e438a89c4f7248707ae2d Aug 10 11:43:18.597230 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-TestVolumeBootPattern-195522797 Aug 10 11:43:18.597230 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User: tempest-TestVolumeBootPattern-195522797-project Aug 10 11:43:18.597230 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Aug 10 11:43:18.597230 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Aug 10 11:43:18.597230 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Id: 83d48f0f35644f23a0fc2216e5ec5a2c Aug 10 11:43:18.597230 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-TestVolumeBootPattern-195522797-project Aug 10 11:43:18.597230 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: method: > Aug 10 11:43:18.597230 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: exception: Instance c07ab9eb-c1e1-4751-be52-6af1da8790e5 could not be found. Aug 10 11:43:18.597230 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: action_args: {'id': 'c07ab9eb-c1e1-4751-be52-6af1da8790e5'} Aug 10 11:43:18.598705 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:43:18.598705 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:43:18.598705 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:43:18.598705 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:43:18.598705 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:43:18.598705 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:43:18.598705 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:43:18.598705 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:43:18.598705 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:43:18.598705 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:43:18.598705 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c07ab9eb-c1e1-4751-be52-6af1da8790e5 could not be found. Aug 10 11:43:18.598705 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:43:18.598705 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:43:18.598705 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:43:18.598705 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:43:18.598705 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:43:18.598705 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:43:18.598705 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:43:18.598705 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:43:18.598705 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:43:18.600372 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:43:18.600372 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:43:18.600372 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:43:18.600372 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:43:18.600372 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:43:18.600372 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:43:18.600372 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:43:18.600372 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c07ab9eb-c1e1-4751-be52-6af1da8790e5 could not be found. Aug 10 11:43:18.600372 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:43:18.600372 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:43:18.600372 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:43:18.600372 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:43:18.600372 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:43:18.600372 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:43:18.600372 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:43:18.600372 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:43:18.600372 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c07ab9eb-c1e1-4751-be52-6af1da8790e5 could not be found. Aug 10 11:43:18.600372 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:43:18.602078 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-7b94caed-68c9-4394-b733-9a005255dde9 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Returning 404 to user: Instance c07ab9eb-c1e1-4751-be52-6af1da8790e5 could not be found. {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:43:18.602078 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-7b94caed-68c9-4394-b733-9a005255dde9 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/c07ab9eb-c1e1-4751-be52-6af1da8790e5" status: 404 len: 111 microversion: 2.1 time: 0.031671 Aug 10 11:43:18.602078 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 461/922] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:43:18 2022] GET /compute/v2.1/servers/c07ab9eb-c1e1-4751-be52-6af1da8790e5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:43:19.108714 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-1616b790-43b7-4b34-9152-745d3eca4f09 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:43:19.109237 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-1616b790-43b7-4b34-9152-745d3eca4f09 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: ed538b97-8602-402c-8ef9-e25e6d71356a] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:43:19.115718 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1616b790-43b7-4b34-9152-745d3eca4f09 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:19.116230 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1616b790-43b7-4b34-9152-745d3eca4f09 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:19.116665 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1616b790-43b7-4b34-9152-745d3eca4f09 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:19.117351 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1616b790-43b7-4b34-9152-745d3eca4f09 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:19.117806 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1616b790-43b7-4b34-9152-745d3eca4f09 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:19.118228 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1616b790-43b7-4b34-9152-745d3eca4f09 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:19.131082 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.wsgi [None req-1616b790-43b7-4b34-9152-745d3eca4f09 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] HTTP exception thrown: Instance ed538b97-8602-402c-8ef9-e25e6d71356a could not be found. Aug 10 11:43:19.132771 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-1616b790-43b7-4b34-9152-745d3eca4f09 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Request method failure captured: Aug 10 11:43:19.132771 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: request: DELETE /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a HTTP/1.1 Aug 10 11:43:19.132771 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Accept: application/json Aug 10 11:43:19.132771 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Aug 10 11:43:19.132771 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Connection: close Aug 10 11:43:19.132771 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Content-Length: 0 Aug 10 11:43:19.132771 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Content-Type: application/json Aug 10 11:43:19.132771 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Host: 10.222.0.62 Aug 10 11:43:19.132771 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Aug 10 11:43:19.132771 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.11 Aug 10 11:43:19.132771 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABi85gTsVtOigC__4GPwavS26SrwsqOH5ANgJJiPHSnmoCdCFlO7Vv0aBh05d4R9g2_M6UNx2hiNfTLZMacfAkeEGchE5_8fTQkP7MDbQDxP9RuWPJOYKVIFLm5not1Hcvns6F-kn4NACae59sRkBuf232itUJbqeNgXSPZetV0wqsoemo Aug 10 11:43:19.132771 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Aug 10 11:43:19.132771 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Aug 10 11:43:19.132771 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Aug 10 11:43:19.132771 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Aug 10 11:43:19.132771 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Aug 10 11:43:19.132771 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Aug 10 11:43:19.132771 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Id: 1c9f7b60a16e438a89c4f7248707ae2d Aug 10 11:43:19.132771 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-TestVolumeBootPattern-195522797 Aug 10 11:43:19.132771 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Role: member,reader Aug 10 11:43:19.132771 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Aug 10 11:43:19.134428 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1c9f7b60a16e438a89c4f7248707ae2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1c9f7b60a16e438a89c4f7248707ae2d", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1c9f7b60a16e438a89c4f7248707ae2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1c9f7b60a16e438a89c4f7248707ae2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:43:19.134428 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-TestVolumeBootPattern-195522797 Aug 10 11:43:19.134428 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant-Id: 1c9f7b60a16e438a89c4f7248707ae2d Aug 10 11:43:19.134428 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-TestVolumeBootPattern-195522797 Aug 10 11:43:19.134428 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User: tempest-TestVolumeBootPattern-195522797-project Aug 10 11:43:19.134428 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Aug 10 11:43:19.134428 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Aug 10 11:43:19.134428 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Id: 83d48f0f35644f23a0fc2216e5ec5a2c Aug 10 11:43:19.134428 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-TestVolumeBootPattern-195522797-project Aug 10 11:43:19.134428 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: method: > Aug 10 11:43:19.134428 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: exception: Instance ed538b97-8602-402c-8ef9-e25e6d71356a could not be found. Aug 10 11:43:19.134428 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: action_args: {'id': 'ed538b97-8602-402c-8ef9-e25e6d71356a'} Aug 10 11:43:19.135403 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:43:19.135403 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:43:19.135403 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:43:19.135403 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:43:19.135403 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:43:19.135403 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:43:19.135403 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:43:19.135403 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:43:19.135403 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:43:19.135403 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:43:19.135403 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed538b97-8602-402c-8ef9-e25e6d71356a could not be found. Aug 10 11:43:19.135403 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:43:19.135403 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:43:19.135403 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:43:19.135403 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:43:19.135403 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:43:19.135403 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:43:19.135403 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:43:19.135403 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:43:19.135403 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:43:19.136970 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:43:19.136970 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 11:43:19.136970 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 11:43:19.136970 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 11:43:19.136970 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 11:43:19.136970 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:43:19.136970 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:43:19.136970 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:43:19.136970 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:43:19.136970 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed538b97-8602-402c-8ef9-e25e6d71356a could not be found. Aug 10 11:43:19.136970 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:43:19.136970 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:43:19.136970 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:43:19.136970 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:43:19.136970 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:43:19.136970 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:43:19.136970 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:43:19.136970 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:43:19.136970 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed538b97-8602-402c-8ef9-e25e6d71356a could not be found. Aug 10 11:43:19.136970 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:43:19.138515 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-1616b790-43b7-4b34-9152-745d3eca4f09 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Returning 404 to user: Instance ed538b97-8602-402c-8ef9-e25e6d71356a could not be found. {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:43:19.138515 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-1616b790-43b7-4b34-9152-745d3eca4f09 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "DELETE /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a" status: 404 len: 111 microversion: 2.1 time: 0.029431 Aug 10 11:43:19.138515 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 462/923] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 10 11:43:19 2022] DELETE /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:43:19.143458 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-a0a4ddd3-b7d7-4af8-8754-d1c4b07c4970 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:43:19.144101 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-a0a4ddd3-b7d7-4af8-8754-d1c4b07c4970 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] [instance: ed538b97-8602-402c-8ef9-e25e6d71356a] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:43:19.150802 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a0a4ddd3-b7d7-4af8-8754-d1c4b07c4970 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:19.151279 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a0a4ddd3-b7d7-4af8-8754-d1c4b07c4970 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:19.151712 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a0a4ddd3-b7d7-4af8-8754-d1c4b07c4970 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:19.152504 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a0a4ddd3-b7d7-4af8-8754-d1c4b07c4970 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:19.152952 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a0a4ddd3-b7d7-4af8-8754-d1c4b07c4970 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:19.153377 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a0a4ddd3-b7d7-4af8-8754-d1c4b07c4970 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:19.167304 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-a0a4ddd3-b7d7-4af8-8754-d1c4b07c4970 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] HTTP exception thrown: Instance ed538b97-8602-402c-8ef9-e25e6d71356a could not be found. Aug 10 11:43:19.168935 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-a0a4ddd3-b7d7-4af8-8754-d1c4b07c4970 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Request method failure captured: Aug 10 11:43:19.168935 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: request: GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a HTTP/1.1 Aug 10 11:43:19.168935 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept: application/json Aug 10 11:43:19.168935 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Aug 10 11:43:19.168935 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Connection: close Aug 10 11:43:19.168935 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Length: 0 Aug 10 11:43:19.168935 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Type: application/json Aug 10 11:43:19.168935 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Host: 10.222.0.62 Aug 10 11:43:19.168935 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Aug 10 11:43:19.168935 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.11 Aug 10 11:43:19.168935 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABi85gTsVtOigC__4GPwavS26SrwsqOH5ANgJJiPHSnmoCdCFlO7Vv0aBh05d4R9g2_M6UNx2hiNfTLZMacfAkeEGchE5_8fTQkP7MDbQDxP9RuWPJOYKVIFLm5not1Hcvns6F-kn4NACae59sRkBuf232itUJbqeNgXSPZetV0wqsoemo Aug 10 11:43:19.168935 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Aug 10 11:43:19.168935 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Aug 10 11:43:19.168935 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Aug 10 11:43:19.168935 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Aug 10 11:43:19.168935 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Aug 10 11:43:19.168935 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Aug 10 11:43:19.168935 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Id: 1c9f7b60a16e438a89c4f7248707ae2d Aug 10 11:43:19.168935 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-TestVolumeBootPattern-195522797 Aug 10 11:43:19.168935 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Role: member,reader Aug 10 11:43:19.168935 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Aug 10 11:43:19.170626 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1c9f7b60a16e438a89c4f7248707ae2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1c9f7b60a16e438a89c4f7248707ae2d", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1c9f7b60a16e438a89c4f7248707ae2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1c9f7b60a16e438a89c4f7248707ae2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:43:19.170626 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-TestVolumeBootPattern-195522797 Aug 10 11:43:19.170626 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Id: 1c9f7b60a16e438a89c4f7248707ae2d Aug 10 11:43:19.170626 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-TestVolumeBootPattern-195522797 Aug 10 11:43:19.170626 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User: tempest-TestVolumeBootPattern-195522797-project Aug 10 11:43:19.170626 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Aug 10 11:43:19.170626 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Aug 10 11:43:19.170626 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Id: 83d48f0f35644f23a0fc2216e5ec5a2c Aug 10 11:43:19.170626 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-TestVolumeBootPattern-195522797-project Aug 10 11:43:19.170626 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: method: > Aug 10 11:43:19.170626 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: exception: Instance ed538b97-8602-402c-8ef9-e25e6d71356a could not be found. Aug 10 11:43:19.170626 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: action_args: {'id': 'ed538b97-8602-402c-8ef9-e25e6d71356a'} Aug 10 11:43:19.171434 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:43:19.171434 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:43:19.171434 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:43:19.171434 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:43:19.171434 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:43:19.171434 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:43:19.171434 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:43:19.171434 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:43:19.171434 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:43:19.171434 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:43:19.171434 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed538b97-8602-402c-8ef9-e25e6d71356a could not be found. Aug 10 11:43:19.171434 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:43:19.171434 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:43:19.171434 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:43:19.171434 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:43:19.171434 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:43:19.171434 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:43:19.171434 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:43:19.171434 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:43:19.171434 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:43:19.172822 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:43:19.172822 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:43:19.172822 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:43:19.172822 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:43:19.172822 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:43:19.172822 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:43:19.172822 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:43:19.172822 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed538b97-8602-402c-8ef9-e25e6d71356a could not be found. Aug 10 11:43:19.172822 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:43:19.172822 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:43:19.172822 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:43:19.172822 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:43:19.172822 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:43:19.172822 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:43:19.172822 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:43:19.172822 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:43:19.172822 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed538b97-8602-402c-8ef9-e25e6d71356a could not be found. Aug 10 11:43:19.172822 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:43:19.173980 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-a0a4ddd3-b7d7-4af8-8754-d1c4b07c4970 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Returning 404 to user: Instance ed538b97-8602-402c-8ef9-e25e6d71356a could not be found. {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:43:19.173980 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-a0a4ddd3-b7d7-4af8-8754-d1c4b07c4970 tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a" status: 404 len: 111 microversion: 2.1 time: 0.031407 Aug 10 11:43:19.173980 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 462/924] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:43:19 2022] GET /compute/v2.1/servers/ed538b97-8602-402c-8ef9-e25e6d71356a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:43:20.639444 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-f45cc883-ad64-4847-9f49-f1053f3e47fc tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] Calling method '.version_select at 0x7fb7ce4b6d30>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:43:20.720771 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-f45cc883-ad64-4847-9f49-f1053f3e47fc tempest-TestVolumeBootPattern-195522797 tempest-TestVolumeBootPattern-195522797-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1346196899" status: 202 len: 0 microversion: 2.1 time: 0.085418 Aug 10 11:43:20.721565 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 463/925] 10.222.0.62 () {58 vars in 1263 bytes} [Wed Aug 10 11:43:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1346196899 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:43:38.774515 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-3d88f226-6337-4352-81f0-7569178f187b tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:43:38.775098 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-3d88f226-6337-4352-81f0-7569178f187b tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:43:38.777533 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:43:38.778294 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=24 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:43:38.782892 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3d88f226-6337-4352-81f0-7569178f187b tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:38.784356 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3d88f226-6337-4352-81f0-7569178f187b tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:38.784356 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3d88f226-6337-4352-81f0-7569178f187b tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:38.784613 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3d88f226-6337-4352-81f0-7569178f187b tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:38.784942 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3d88f226-6337-4352-81f0-7569178f187b tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:38.785371 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3d88f226-6337-4352-81f0-7569178f187b tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:38.808126 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.objects.instance [None req-3d88f226-6337-4352-81f0-7569178f187b tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lazy-loading 'flavor' on Instance uuid 2dd20638-cdb6-4db7-a23e-c98c00e103d9 {{(pid=124683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:43:39.110151 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-3d88f226-6337-4352-81f0-7569178f187b tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "POST /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9/action" status: 202 len: 0 microversion: 2.1 time: 0.340079 Aug 10 11:43:39.110751 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 463/926] 10.222.0.62 () {60 vars in 1278 bytes} [Wed Aug 10 11:43:38 2022] POST /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9/action => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:43:39.116703 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:43:39.117502 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:43:39.121433 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-79bd1bcf-ecb5-43bd-994e-97be9216817a tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:43:39.122060 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-79bd1bcf-ecb5-43bd-994e-97be9216817a tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:43:39.129190 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-79bd1bcf-ecb5-43bd-994e-97be9216817a tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:39.130183 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-79bd1bcf-ecb5-43bd-994e-97be9216817a tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:39.130627 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-79bd1bcf-ecb5-43bd-994e-97be9216817a tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:39.131339 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-79bd1bcf-ecb5-43bd-994e-97be9216817a tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:39.131796 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-79bd1bcf-ecb5-43bd-994e-97be9216817a tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:39.132257 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-79bd1bcf-ecb5-43bd-994e-97be9216817a tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:39.269288 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-79bd1bcf-ecb5-43bd-994e-97be9216817a tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c1ca0941b2455995640460a2027f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d656a5891ea40268b8be271b4cc7aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:43:39.277270 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-79bd1bcf-ecb5-43bd-994e-97be9216817a tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9" status: 200 len: 1570 microversion: 2.1 time: 0.162052 Aug 10 11:43:39.277841 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 464/927] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:43:39 2022] GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9 => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:43:40.299344 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-62f8d65e-925e-43e4-a24d-fe12551eefc7 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:43:40.300092 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-62f8d65e-925e-43e4-a24d-fe12551eefc7 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:43:40.306379 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-62f8d65e-925e-43e4-a24d-fe12551eefc7 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:40.306855 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-62f8d65e-925e-43e4-a24d-fe12551eefc7 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:40.307284 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-62f8d65e-925e-43e4-a24d-fe12551eefc7 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:40.307976 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-62f8d65e-925e-43e4-a24d-fe12551eefc7 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:40.308429 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-62f8d65e-925e-43e4-a24d-fe12551eefc7 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:40.308849 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-62f8d65e-925e-43e4-a24d-fe12551eefc7 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:40.445296 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-62f8d65e-925e-43e4-a24d-fe12551eefc7 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c1ca0941b2455995640460a2027f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d656a5891ea40268b8be271b4cc7aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:43:40.452863 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-62f8d65e-925e-43e4-a24d-fe12551eefc7 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9" status: 200 len: 1570 microversion: 2.1 time: 0.158529 Aug 10 11:43:40.459884 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 464/928] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:43:40 2022] GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:43:41.474614 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-75ac6d6a-9673-4f05-9fe5-bc5a41261d48 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:43:41.476301 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-75ac6d6a-9673-4f05-9fe5-bc5a41261d48 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:43:41.484335 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-75ac6d6a-9673-4f05-9fe5-bc5a41261d48 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:41.485001 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-75ac6d6a-9673-4f05-9fe5-bc5a41261d48 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:41.485631 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-75ac6d6a-9673-4f05-9fe5-bc5a41261d48 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:41.486376 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-75ac6d6a-9673-4f05-9fe5-bc5a41261d48 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:41.486827 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-75ac6d6a-9673-4f05-9fe5-bc5a41261d48 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:41.487250 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-75ac6d6a-9673-4f05-9fe5-bc5a41261d48 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:41.622888 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-75ac6d6a-9673-4f05-9fe5-bc5a41261d48 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c1ca0941b2455995640460a2027f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d656a5891ea40268b8be271b4cc7aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:43:41.630291 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-75ac6d6a-9673-4f05-9fe5-bc5a41261d48 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9" status: 200 len: 1570 microversion: 2.1 time: 0.159638 Aug 10 11:43:41.630857 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 465/929] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:43:41 2022] GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9 => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:43:42.653499 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-9359784d-89b3-4087-85f7-6dd2be012057 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:43:42.654113 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-9359784d-89b3-4087-85f7-6dd2be012057 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:43:42.660070 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9359784d-89b3-4087-85f7-6dd2be012057 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:42.660548 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9359784d-89b3-4087-85f7-6dd2be012057 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:42.660982 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9359784d-89b3-4087-85f7-6dd2be012057 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:42.661661 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9359784d-89b3-4087-85f7-6dd2be012057 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:42.662109 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9359784d-89b3-4087-85f7-6dd2be012057 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:42.662576 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9359784d-89b3-4087-85f7-6dd2be012057 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:42.806904 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-9359784d-89b3-4087-85f7-6dd2be012057 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c1ca0941b2455995640460a2027f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d656a5891ea40268b8be271b4cc7aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:43:42.814971 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-9359784d-89b3-4087-85f7-6dd2be012057 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9" status: 200 len: 1570 microversion: 2.1 time: 0.165506 Aug 10 11:43:42.815524 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 465/930] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:43:42 2022] GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9 => generated 1570 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:43:43.835581 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-6eb243e0-5b08-4d23-b306-8b5913345eef tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:43:43.836248 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-6eb243e0-5b08-4d23-b306-8b5913345eef tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:43:43.842604 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6eb243e0-5b08-4d23-b306-8b5913345eef tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:43.843081 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6eb243e0-5b08-4d23-b306-8b5913345eef tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:43.843511 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6eb243e0-5b08-4d23-b306-8b5913345eef tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:43.844229 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6eb243e0-5b08-4d23-b306-8b5913345eef tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:43.844682 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6eb243e0-5b08-4d23-b306-8b5913345eef tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:43.845100 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6eb243e0-5b08-4d23-b306-8b5913345eef tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:43.974985 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-6eb243e0-5b08-4d23-b306-8b5913345eef tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c1ca0941b2455995640460a2027f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d656a5891ea40268b8be271b4cc7aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:43:43.982940 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-6eb243e0-5b08-4d23-b306-8b5913345eef tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9" status: 200 len: 1570 microversion: 2.1 time: 0.151232 Aug 10 11:43:43.983718 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 466/931] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:43:43 2022] GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:43:45.004202 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-d744af8b-1c9f-4d0b-922a-7a07508e059c tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:43:45.004839 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-d744af8b-1c9f-4d0b-922a-7a07508e059c tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:43:45.011758 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d744af8b-1c9f-4d0b-922a-7a07508e059c tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:45.012262 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d744af8b-1c9f-4d0b-922a-7a07508e059c tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:45.012695 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d744af8b-1c9f-4d0b-922a-7a07508e059c tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:45.013411 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d744af8b-1c9f-4d0b-922a-7a07508e059c tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:45.013860 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d744af8b-1c9f-4d0b-922a-7a07508e059c tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:45.014275 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d744af8b-1c9f-4d0b-922a-7a07508e059c tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:45.143831 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-d744af8b-1c9f-4d0b-922a-7a07508e059c tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c1ca0941b2455995640460a2027f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d656a5891ea40268b8be271b4cc7aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:43:45.152644 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-d744af8b-1c9f-4d0b-922a-7a07508e059c tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9" status: 200 len: 1570 microversion: 2.1 time: 0.152331 Aug 10 11:43:45.154437 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 466/932] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:43:44 2022] GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:43:46.173849 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-21c063f0-dd6c-4ae6-b228-e58d3f5e59e4 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:43:46.174473 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-21c063f0-dd6c-4ae6-b228-e58d3f5e59e4 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:43:46.181686 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-21c063f0-dd6c-4ae6-b228-e58d3f5e59e4 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:46.182173 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-21c063f0-dd6c-4ae6-b228-e58d3f5e59e4 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:46.182613 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-21c063f0-dd6c-4ae6-b228-e58d3f5e59e4 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:46.183314 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-21c063f0-dd6c-4ae6-b228-e58d3f5e59e4 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:46.183772 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-21c063f0-dd6c-4ae6-b228-e58d3f5e59e4 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:46.184226 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-21c063f0-dd6c-4ae6-b228-e58d3f5e59e4 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:46.311283 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-21c063f0-dd6c-4ae6-b228-e58d3f5e59e4 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c1ca0941b2455995640460a2027f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d656a5891ea40268b8be271b4cc7aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:43:46.318838 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-21c063f0-dd6c-4ae6-b228-e58d3f5e59e4 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9" status: 200 len: 1570 microversion: 2.1 time: 0.148823 Aug 10 11:43:46.319490 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 467/933] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:43:46 2022] GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:43:46.380291 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-cbe7aa67-e222-4ce8-b983-7f06f1d13512 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:43:46.380777 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-cbe7aa67-e222-4ce8-b983-7f06f1d13512 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: 556949a2-ac97-40b2-9827-ffa317d3c2a1] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:43:46.387065 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cbe7aa67-e222-4ce8-b983-7f06f1d13512 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:46.387543 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cbe7aa67-e222-4ce8-b983-7f06f1d13512 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:46.387994 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cbe7aa67-e222-4ce8-b983-7f06f1d13512 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:46.388681 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cbe7aa67-e222-4ce8-b983-7f06f1d13512 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:46.389139 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cbe7aa67-e222-4ce8-b983-7f06f1d13512 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:46.389563 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cbe7aa67-e222-4ce8-b983-7f06f1d13512 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:46.413181 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-cbe7aa67-e222-4ce8-b983-7f06f1d13512 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/556949a2-ac97-40b2-9827-ffa317d3c2a1/ips" status: 200 len: 151 microversion: 2.1 time: 0.035937 Aug 10 11:43:46.413793 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 467/934] 10.222.0.62 () {58 vars in 1248 bytes} [Wed Aug 10 11:43:46 2022] GET /compute/v2.1/servers/556949a2-ac97-40b2-9827-ffa317d3c2a1/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:43:47.339412 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-87556368-8728-481a-8a2d-b7b8f420562a tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:43:47.340051 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-87556368-8728-481a-8a2d-b7b8f420562a tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:43:47.346424 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-87556368-8728-481a-8a2d-b7b8f420562a tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:47.346906 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-87556368-8728-481a-8a2d-b7b8f420562a tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:47.347374 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-87556368-8728-481a-8a2d-b7b8f420562a tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:47.348116 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-87556368-8728-481a-8a2d-b7b8f420562a tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:47.348572 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-87556368-8728-481a-8a2d-b7b8f420562a tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:47.348998 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-87556368-8728-481a-8a2d-b7b8f420562a tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:47.483010 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-87556368-8728-481a-8a2d-b7b8f420562a tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c1ca0941b2455995640460a2027f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d656a5891ea40268b8be271b4cc7aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:43:47.490765 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-87556368-8728-481a-8a2d-b7b8f420562a tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9" status: 200 len: 1570 microversion: 2.1 time: 0.154988 Aug 10 11:43:47.491591 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 468/935] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:43:47 2022] GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:43:48.020405 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-c1c1e18b-ab17-4100-a0b2-3d1a088bb9a6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a6546e78-25c5-4bcb-a2b5-68e4aa9b4d5b"}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:43:48.023550 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-c1c1e18b-ab17-4100-a0b2-3d1a088bb9a6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: 556949a2-ac97-40b2-9827-ffa317d3c2a1] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:43:48.030093 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c1c1e18b-ab17-4100-a0b2-3d1a088bb9a6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:48.030571 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c1c1e18b-ab17-4100-a0b2-3d1a088bb9a6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:48.031003 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c1c1e18b-ab17-4100-a0b2-3d1a088bb9a6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:48.031798 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c1c1e18b-ab17-4100-a0b2-3d1a088bb9a6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:48.032272 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c1c1e18b-ab17-4100-a0b2-3d1a088bb9a6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:48.032695 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c1c1e18b-ab17-4100-a0b2-3d1a088bb9a6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:48.512866 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-8c9b241f-a129-45d9-8895-97cb15b7b0b8 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:43:48.513490 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-8c9b241f-a129-45d9-8895-97cb15b7b0b8 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:43:48.520387 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8c9b241f-a129-45d9-8895-97cb15b7b0b8 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:48.520881 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8c9b241f-a129-45d9-8895-97cb15b7b0b8 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:48.522413 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8c9b241f-a129-45d9-8895-97cb15b7b0b8 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:48.523038 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8c9b241f-a129-45d9-8895-97cb15b7b0b8 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:48.523491 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8c9b241f-a129-45d9-8895-97cb15b7b0b8 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:48.523925 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8c9b241f-a129-45d9-8895-97cb15b7b0b8 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:48.659782 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-8c9b241f-a129-45d9-8895-97cb15b7b0b8 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c1ca0941b2455995640460a2027f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d656a5891ea40268b8be271b4cc7aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:43:48.667513 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-8c9b241f-a129-45d9-8895-97cb15b7b0b8 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9" status: 200 len: 1570 microversion: 2.1 time: 0.158545 Aug 10 11:43:48.668104 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 469/936] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:43:48 2022] GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:43:48.774535 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-c1c1e18b-ab17-4100-a0b2-3d1a088bb9a6 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "POST /compute/v2.1/servers/556949a2-ac97-40b2-9827-ffa317d3c2a1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.757849 Aug 10 11:43:48.775425 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 468/937] 10.222.0.62 () {60 vars in 1323 bytes} [Wed Aug 10 11:43:48 2022] POST /compute/v2.1/servers/556949a2-ac97-40b2-9827-ffa317d3c2a1/os-volume_attachments => generated 194 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:43:49.688765 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-4a2f51c7-bf13-45f9-8322-c1b312dba03f tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:43:49.689386 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-4a2f51c7-bf13-45f9-8322-c1b312dba03f tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:43:49.696590 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4a2f51c7-bf13-45f9-8322-c1b312dba03f tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:49.697088 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4a2f51c7-bf13-45f9-8322-c1b312dba03f tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:49.697918 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4a2f51c7-bf13-45f9-8322-c1b312dba03f tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:49.698253 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4a2f51c7-bf13-45f9-8322-c1b312dba03f tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:49.698715 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4a2f51c7-bf13-45f9-8322-c1b312dba03f tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:49.699166 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4a2f51c7-bf13-45f9-8322-c1b312dba03f tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:50.154503 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-4a2f51c7-bf13-45f9-8322-c1b312dba03f tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c1ca0941b2455995640460a2027f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d656a5891ea40268b8be271b4cc7aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:43:50.162508 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-4a2f51c7-bf13-45f9-8322-c1b312dba03f tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9" status: 200 len: 1570 microversion: 2.1 time: 0.477063 Aug 10 11:43:50.163192 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 470/938] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:43:49 2022] GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9 => generated 1570 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:43:51.184092 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-bd025fce-7067-4a7d-a2ca-3819a7920c76 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:43:51.184719 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-bd025fce-7067-4a7d-a2ca-3819a7920c76 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:43:51.190922 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bd025fce-7067-4a7d-a2ca-3819a7920c76 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:51.191412 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bd025fce-7067-4a7d-a2ca-3819a7920c76 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:51.191856 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bd025fce-7067-4a7d-a2ca-3819a7920c76 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:51.192590 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bd025fce-7067-4a7d-a2ca-3819a7920c76 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:51.193047 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bd025fce-7067-4a7d-a2ca-3819a7920c76 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:51.193506 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bd025fce-7067-4a7d-a2ca-3819a7920c76 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:51.323654 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-bd025fce-7067-4a7d-a2ca-3819a7920c76 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c1ca0941b2455995640460a2027f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d656a5891ea40268b8be271b4cc7aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:43:51.331103 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-bd025fce-7067-4a7d-a2ca-3819a7920c76 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9" status: 200 len: 1570 microversion: 2.1 time: 0.152072 Aug 10 11:43:51.331670 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 469/939] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:43:51 2022] GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:43:52.353404 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-89bb311f-8cc0-434d-a245-d9663dca40ff tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:43:52.354031 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-89bb311f-8cc0-434d-a245-d9663dca40ff tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:43:52.360809 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-89bb311f-8cc0-434d-a245-d9663dca40ff tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:52.361312 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-89bb311f-8cc0-434d-a245-d9663dca40ff tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:52.361759 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-89bb311f-8cc0-434d-a245-d9663dca40ff tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:52.362474 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-89bb311f-8cc0-434d-a245-d9663dca40ff tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:52.362935 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-89bb311f-8cc0-434d-a245-d9663dca40ff tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:52.363365 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-89bb311f-8cc0-434d-a245-d9663dca40ff tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:52.495306 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-89bb311f-8cc0-434d-a245-d9663dca40ff tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c1ca0941b2455995640460a2027f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d656a5891ea40268b8be271b4cc7aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:43:52.502897 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-89bb311f-8cc0-434d-a245-d9663dca40ff tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9" status: 200 len: 1570 microversion: 2.1 time: 0.153978 Aug 10 11:43:52.503452 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 471/940] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:43:52 2022] GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:43:53.523816 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-8441fb49-6bf2-4eb2-a991-dea29b3d5f39 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:43:53.524440 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-8441fb49-6bf2-4eb2-a991-dea29b3d5f39 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:43:53.530733 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8441fb49-6bf2-4eb2-a991-dea29b3d5f39 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:53.531211 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8441fb49-6bf2-4eb2-a991-dea29b3d5f39 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:53.531643 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8441fb49-6bf2-4eb2-a991-dea29b3d5f39 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:53.532355 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8441fb49-6bf2-4eb2-a991-dea29b3d5f39 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:53.532807 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8441fb49-6bf2-4eb2-a991-dea29b3d5f39 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:53.533229 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8441fb49-6bf2-4eb2-a991-dea29b3d5f39 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:53.660738 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-8441fb49-6bf2-4eb2-a991-dea29b3d5f39 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c1ca0941b2455995640460a2027f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d656a5891ea40268b8be271b4cc7aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:43:53.670021 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-8441fb49-6bf2-4eb2-a991-dea29b3d5f39 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9" status: 200 len: 1511 microversion: 2.1 time: 0.150543 Aug 10 11:43:53.670581 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 470/941] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:43:53 2022] GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9 => generated 1511 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:43:53.690853 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-8a7b82d4-6542-45e5-a95b-16f4f709d0cf tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:43:53.691448 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-8a7b82d4-6542-45e5-a95b-16f4f709d0cf tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:43:53.698948 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8a7b82d4-6542-45e5-a95b-16f4f709d0cf tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:53.699427 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8a7b82d4-6542-45e5-a95b-16f4f709d0cf tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:53.699861 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8a7b82d4-6542-45e5-a95b-16f4f709d0cf tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:53.700569 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8a7b82d4-6542-45e5-a95b-16f4f709d0cf tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:53.701019 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8a7b82d4-6542-45e5-a95b-16f4f709d0cf tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:53.701439 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8a7b82d4-6542-45e5-a95b-16f4f709d0cf tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:53.743376 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-8a7b82d4-6542-45e5-a95b-16f4f709d0cf tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124682) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 10 11:43:53.983096 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8a7b82d4-6542-45e5-a95b-16f4f709d0cf tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [56105896-92a6-448f-8874-fbd6e6320e92] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 10 11:43:54.992448 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO oslo.messaging._drivers.impl_rabbit [None req-8a7b82d4-6542-45e5-a95b-16f4f709d0cf tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [56105896-92a6-448f-8874-fbd6e6320e92] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 34592. Aug 10 11:43:54.995464 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-8a7b82d4-6542-45e5-a95b-16f4f709d0cf tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "POST /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9/action" status: 202 len: 0 microversion: 2.1 time: 1.308522 Aug 10 11:43:54.996188 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 472/942] 10.222.0.62 () {60 vars in 1278 bytes} [Wed Aug 10 11:43:53 2022] POST /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9/action => generated 0 bytes in 1310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:43:55.004564 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-070ebe4a-5db6-4156-b929-60c7c1ab3fa3 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:43:55.005180 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-070ebe4a-5db6-4156-b929-60c7c1ab3fa3 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:43:55.012651 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-070ebe4a-5db6-4156-b929-60c7c1ab3fa3 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:55.015731 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-070ebe4a-5db6-4156-b929-60c7c1ab3fa3 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:55.015731 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-070ebe4a-5db6-4156-b929-60c7c1ab3fa3 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:55.015731 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-070ebe4a-5db6-4156-b929-60c7c1ab3fa3 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:55.015731 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-070ebe4a-5db6-4156-b929-60c7c1ab3fa3 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:55.016235 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-070ebe4a-5db6-4156-b929-60c7c1ab3fa3 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:55.152915 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-070ebe4a-5db6-4156-b929-60c7c1ab3fa3 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c1ca0941b2455995640460a2027f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d656a5891ea40268b8be271b4cc7aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:43:55.161226 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-070ebe4a-5db6-4156-b929-60c7c1ab3fa3 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9" status: 200 len: 1519 microversion: 2.1 time: 0.160698 Aug 10 11:43:55.169758 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 471/943] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:43:54 2022] GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9 => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:43:55.839517 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-989932d3-ba59-4d06-8881-71d44b429d3b req-46c72f7e-484e-4674-8fe0-fe404901d489 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dd20638-cdb6-4db7-a23e-c98c00e103d9", "name": "network-vif-unplugged", "status": "completed", "tag": "2743679b-eeea-46d5-a860-adc80ef124b6"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:43:55.850662 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-989932d3-ba59-4d06-8881-71d44b429d3b req-46c72f7e-484e-4674-8fe0-fe404901d489 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:55.851140 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-989932d3-ba59-4d06-8881-71d44b429d3b req-46c72f7e-484e-4674-8fe0-fe404901d489 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:55.851568 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-989932d3-ba59-4d06-8881-71d44b429d3b req-46c72f7e-484e-4674-8fe0-fe404901d489 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:55.861662 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.compute.server_external_events [req-989932d3-ba59-4d06-8881-71d44b429d3b req-46c72f7e-484e-4674-8fe0-fe404901d489 service nova] Unable to find a host for instance 2dd20638-cdb6-4db7-a23e-c98c00e103d9. Dropping event network-vif-unplugged {{(pid=124682) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 10 11:43:55.862527 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-989932d3-ba59-4d06-8881-71d44b429d3b req-46c72f7e-484e-4674-8fe0-fe404901d489 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.145368 Aug 10 11:43:55.863098 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 473/944] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 146 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 10 11:43:56.182833 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-3ebaf453-6dea-4d3d-b4cd-e52cb9e24a3f tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:43:56.183566 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-3ebaf453-6dea-4d3d-b4cd-e52cb9e24a3f tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:43:56.190183 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3ebaf453-6dea-4d3d-b4cd-e52cb9e24a3f tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:56.190747 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3ebaf453-6dea-4d3d-b4cd-e52cb9e24a3f tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:56.191210 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3ebaf453-6dea-4d3d-b4cd-e52cb9e24a3f tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:56.191904 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3ebaf453-6dea-4d3d-b4cd-e52cb9e24a3f tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:56.192387 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3ebaf453-6dea-4d3d-b4cd-e52cb9e24a3f tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:56.192817 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3ebaf453-6dea-4d3d-b4cd-e52cb9e24a3f tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:56.329654 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-3ebaf453-6dea-4d3d-b4cd-e52cb9e24a3f tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c1ca0941b2455995640460a2027f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d656a5891ea40268b8be271b4cc7aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:43:56.337657 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-3ebaf453-6dea-4d3d-b4cd-e52cb9e24a3f tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9" status: 200 len: 1519 microversion: 2.1 time: 0.159570 Aug 10 11:43:56.338213 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 472/945] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:43:56 2022] GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:43:56.449208 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-7a170a97-ba1f-41f3-ab67-c0008ba432aa tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:43:56.449715 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-7a170a97-ba1f-41f3-ab67-c0008ba432aa tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: 556949a2-ac97-40b2-9827-ffa317d3c2a1] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:43:56.456066 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7a170a97-ba1f-41f3-ab67-c0008ba432aa tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:56.456550 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7a170a97-ba1f-41f3-ab67-c0008ba432aa tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:56.456989 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7a170a97-ba1f-41f3-ab67-c0008ba432aa tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:56.457713 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7a170a97-ba1f-41f3-ab67-c0008ba432aa tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:56.458238 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7a170a97-ba1f-41f3-ab67-c0008ba432aa tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:56.458672 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7a170a97-ba1f-41f3-ab67-c0008ba432aa tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:56.540198 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.objects.instance [None req-7a170a97-ba1f-41f3-ab67-c0008ba432aa tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lazy-loading 'services' on Instance uuid 556949a2-ac97-40b2-9827-ffa317d3c2a1 {{(pid=124682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:43:56.746546 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-7a170a97-ba1f-41f3-ab67-c0008ba432aa tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "DELETE /compute/v2.1/servers/556949a2-ac97-40b2-9827-ffa317d3c2a1/os-volume_attachments/a6546e78-25c5-4bcb-a2b5-68e4aa9b4d5b" status: 202 len: 0 microversion: 2.1 time: 0.301200 Aug 10 11:43:56.747125 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 474/946] 10.222.0.62 () {58 vars in 1416 bytes} [Wed Aug 10 11:43:56 2022] DELETE /compute/v2.1/servers/556949a2-ac97-40b2-9827-ffa317d3c2a1/os-volume_attachments/a6546e78-25c5-4bcb-a2b5-68e4aa9b4d5b => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:43:56.756608 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-2f283e21-39a5-47f5-ac3a-4c147804fc29 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:43:56.758977 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-2f283e21-39a5-47f5-ac3a-4c147804fc29 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: 556949a2-ac97-40b2-9827-ffa317d3c2a1] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:43:56.765017 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2f283e21-39a5-47f5-ac3a-4c147804fc29 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:56.765773 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2f283e21-39a5-47f5-ac3a-4c147804fc29 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:56.766185 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2f283e21-39a5-47f5-ac3a-4c147804fc29 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:56.766865 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2f283e21-39a5-47f5-ac3a-4c147804fc29 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:56.767577 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2f283e21-39a5-47f5-ac3a-4c147804fc29 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:56.768020 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2f283e21-39a5-47f5-ac3a-4c147804fc29 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:56.801566 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-2f283e21-39a5-47f5-ac3a-4c147804fc29 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/556949a2-ac97-40b2-9827-ffa317d3c2a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049698 Aug 10 11:43:56.802622 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 473/947] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 10 11:43:56 2022] GET /compute/v2.1/servers/556949a2-ac97-40b2-9827-ffa317d3c2a1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:43:57.358689 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-31efdfcf-4fcb-4849-b439-86b917b3f970 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:43:57.359385 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-31efdfcf-4fcb-4849-b439-86b917b3f970 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:43:57.366119 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-31efdfcf-4fcb-4849-b439-86b917b3f970 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:57.368584 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-31efdfcf-4fcb-4849-b439-86b917b3f970 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:57.368584 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-31efdfcf-4fcb-4849-b439-86b917b3f970 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:57.368584 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-31efdfcf-4fcb-4849-b439-86b917b3f970 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:57.368584 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-31efdfcf-4fcb-4849-b439-86b917b3f970 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:57.368989 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-31efdfcf-4fcb-4849-b439-86b917b3f970 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:57.497976 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-31efdfcf-4fcb-4849-b439-86b917b3f970 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c1ca0941b2455995640460a2027f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d656a5891ea40268b8be271b4cc7aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:43:57.505628 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-31efdfcf-4fcb-4849-b439-86b917b3f970 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9" status: 200 len: 1519 microversion: 2.1 time: 0.151070 Aug 10 11:43:57.507719 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 475/948] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:43:57 2022] GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:43:57.815345 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-53d5429b-a5e1-4d43-9b28-ef01c8b1413e tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:43:57.817734 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-53d5429b-a5e1-4d43-9b28-ef01c8b1413e tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: 556949a2-ac97-40b2-9827-ffa317d3c2a1] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:43:57.824971 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-53d5429b-a5e1-4d43-9b28-ef01c8b1413e tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:57.825454 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-53d5429b-a5e1-4d43-9b28-ef01c8b1413e tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:57.825893 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-53d5429b-a5e1-4d43-9b28-ef01c8b1413e tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:57.826577 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-53d5429b-a5e1-4d43-9b28-ef01c8b1413e tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:57.827031 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-53d5429b-a5e1-4d43-9b28-ef01c8b1413e tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:57.827456 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-53d5429b-a5e1-4d43-9b28-ef01c8b1413e tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:57.856024 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-53d5429b-a5e1-4d43-9b28-ef01c8b1413e tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/556949a2-ac97-40b2-9827-ffa317d3c2a1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044711 Aug 10 11:43:57.856574 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 474/949] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 10 11:43:57 2022] GET /compute/v2.1/servers/556949a2-ac97-40b2-9827-ffa317d3c2a1/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 11:43:57.917754 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-518f5aa5-3745-4177-96a9-19170551d3dc tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:43:57.918241 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-518f5aa5-3745-4177-96a9-19170551d3dc tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: 556949a2-ac97-40b2-9827-ffa317d3c2a1] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:43:57.924566 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-518f5aa5-3745-4177-96a9-19170551d3dc tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:57.925053 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-518f5aa5-3745-4177-96a9-19170551d3dc tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:57.925492 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-518f5aa5-3745-4177-96a9-19170551d3dc tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:57.926183 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-518f5aa5-3745-4177-96a9-19170551d3dc tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:57.926639 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-518f5aa5-3745-4177-96a9-19170551d3dc tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:57.927069 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-518f5aa5-3745-4177-96a9-19170551d3dc tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:57.952729 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-518f5aa5-3745-4177-96a9-19170551d3dc tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: 556949a2-ac97-40b2-9827-ffa317d3c2a1] Going to try to terminate instance {{(pid=124682) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:43:58.256587 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-518f5aa5-3745-4177-96a9-19170551d3dc tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "DELETE /compute/v2.1/servers/556949a2-ac97-40b2-9827-ffa317d3c2a1" status: 204 len: 0 microversion: 2.1 time: 0.341586 Aug 10 11:43:58.257451 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 476/950] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 10 11:43:57 2022] DELETE /compute/v2.1/servers/556949a2-ac97-40b2-9827-ffa317d3c2a1 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:43:58.265971 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-46344efb-8fd0-49b2-88f4-f81f0d476c25 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:43:58.266613 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-46344efb-8fd0-49b2-88f4-f81f0d476c25 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: 556949a2-ac97-40b2-9827-ffa317d3c2a1] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:43:58.272780 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-46344efb-8fd0-49b2-88f4-f81f0d476c25 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:58.273253 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-46344efb-8fd0-49b2-88f4-f81f0d476c25 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:58.273686 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-46344efb-8fd0-49b2-88f4-f81f0d476c25 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:58.274367 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-46344efb-8fd0-49b2-88f4-f81f0d476c25 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:58.274815 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-46344efb-8fd0-49b2-88f4-f81f0d476c25 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:58.275233 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-46344efb-8fd0-49b2-88f4-f81f0d476c25 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:58.406243 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-46344efb-8fd0-49b2-88f4-f81f0d476c25 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:43:58.414439 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-46344efb-8fd0-49b2-88f4-f81f0d476c25 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/556949a2-ac97-40b2-9827-ffa317d3c2a1" status: 200 len: 1681 microversion: 2.1 time: 0.152557 Aug 10 11:43:58.415003 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 475/951] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:43:58 2022] GET /compute/v2.1/servers/556949a2-ac97-40b2-9827-ffa317d3c2a1 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:43:58.528017 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-7c2e62ba-920a-4594-9bf8-a71c5b0d6a06 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:43:58.528631 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-7c2e62ba-920a-4594-9bf8-a71c5b0d6a06 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:43:58.534558 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7c2e62ba-920a-4594-9bf8-a71c5b0d6a06 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:58.535036 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7c2e62ba-920a-4594-9bf8-a71c5b0d6a06 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:58.535467 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7c2e62ba-920a-4594-9bf8-a71c5b0d6a06 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:58.536182 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7c2e62ba-920a-4594-9bf8-a71c5b0d6a06 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:58.536634 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7c2e62ba-920a-4594-9bf8-a71c5b0d6a06 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:58.538058 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7c2e62ba-920a-4594-9bf8-a71c5b0d6a06 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:58.670072 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-7c2e62ba-920a-4594-9bf8-a71c5b0d6a06 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c1ca0941b2455995640460a2027f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d656a5891ea40268b8be271b4cc7aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:43:58.673546 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:43:58.678393 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-7c2e62ba-920a-4594-9bf8-a71c5b0d6a06 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9" status: 200 len: 1519 microversion: 2.1 time: 0.154159 Aug 10 11:43:58.678948 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 477/952] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:43:58 2022] GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:43:59.434827 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-0ad4e1e7-5e5d-4b8d-9343-fb4b7231209f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:43:59.435499 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-0ad4e1e7-5e5d-4b8d-9343-fb4b7231209f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: 556949a2-ac97-40b2-9827-ffa317d3c2a1] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:43:59.441919 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0ad4e1e7-5e5d-4b8d-9343-fb4b7231209f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:59.442408 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0ad4e1e7-5e5d-4b8d-9343-fb4b7231209f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:59.442849 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0ad4e1e7-5e5d-4b8d-9343-fb4b7231209f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:59.444214 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0ad4e1e7-5e5d-4b8d-9343-fb4b7231209f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:59.444670 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0ad4e1e7-5e5d-4b8d-9343-fb4b7231209f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:59.445102 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0ad4e1e7-5e5d-4b8d-9343-fb4b7231209f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:59.463003 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:43:59.576674 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-0ad4e1e7-5e5d-4b8d-9343-fb4b7231209f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:43:59.584083 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-0ad4e1e7-5e5d-4b8d-9343-fb4b7231209f tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/556949a2-ac97-40b2-9827-ffa317d3c2a1" status: 200 len: 1681 microversion: 2.1 time: 0.153030 Aug 10 11:43:59.584843 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 476/953] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:43:59 2022] GET /compute/v2.1/servers/556949a2-ac97-40b2-9827-ffa317d3c2a1 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:43:59.699411 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-c00b254a-f7b6-4e6b-a549-bccd23f54e15 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:43:59.699948 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-c00b254a-f7b6-4e6b-a549-bccd23f54e15 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:43:59.706642 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c00b254a-f7b6-4e6b-a549-bccd23f54e15 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:59.707129 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c00b254a-f7b6-4e6b-a549-bccd23f54e15 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:59.707573 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c00b254a-f7b6-4e6b-a549-bccd23f54e15 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:59.708293 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c00b254a-f7b6-4e6b-a549-bccd23f54e15 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:43:59.708813 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c00b254a-f7b6-4e6b-a549-bccd23f54e15 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:43:59.709436 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c00b254a-f7b6-4e6b-a549-bccd23f54e15 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:43:59.928144 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c00b254a-f7b6-4e6b-a549-bccd23f54e15 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c1ca0941b2455995640460a2027f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d656a5891ea40268b8be271b4cc7aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:43:59.935871 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-c00b254a-f7b6-4e6b-a549-bccd23f54e15 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9" status: 200 len: 1519 microversion: 2.1 time: 0.240469 Aug 10 11:43:59.936487 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 478/954] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:43:59 2022] GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9 => generated 1519 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:44:00.605731 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-c828e30d-9238-450e-a244-c0fae2dab6b5 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:00.606374 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-c828e30d-9238-450e-a244-c0fae2dab6b5 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: 556949a2-ac97-40b2-9827-ffa317d3c2a1] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:00.613410 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c828e30d-9238-450e-a244-c0fae2dab6b5 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:00.615985 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c828e30d-9238-450e-a244-c0fae2dab6b5 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:00.615985 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c828e30d-9238-450e-a244-c0fae2dab6b5 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:00.615985 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c828e30d-9238-450e-a244-c0fae2dab6b5 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:00.616630 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c828e30d-9238-450e-a244-c0fae2dab6b5 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:00.617060 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c828e30d-9238-450e-a244-c0fae2dab6b5 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:00.686988 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-c828e30d-9238-450e-a244-c0fae2dab6b5 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f61f9a578834243b0d11888c397deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1275e554301b4d019da34186581fc0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:44:00.696362 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-c828e30d-9238-450e-a244-c0fae2dab6b5 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/556949a2-ac97-40b2-9827-ffa317d3c2a1" status: 200 len: 1614 microversion: 2.1 time: 0.094348 Aug 10 11:44:00.697449 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 477/955] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:44:00 2022] GET /compute/v2.1/servers/556949a2-ac97-40b2-9827-ffa317d3c2a1 => generated 1614 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:44:00.715188 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-ab7c996b-68b8-401c-b4d8-0988eaf7d5a5 req-8472f898-1b8c-4dd4-bde7-10a84e5a6c81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "556949a2-ac97-40b2-9827-ffa317d3c2a1", "name": "network-vif-deleted", "tag": "1828c28e-1b8e-4663-b048-5918944a0b41"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:44:00.726446 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-ab7c996b-68b8-401c-b4d8-0988eaf7d5a5 req-8472f898-1b8c-4dd4-bde7-10a84e5a6c81 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:00.726997 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-ab7c996b-68b8-401c-b4d8-0988eaf7d5a5 req-8472f898-1b8c-4dd4-bde7-10a84e5a6c81 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:00.727436 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-ab7c996b-68b8-401c-b4d8-0988eaf7d5a5 req-8472f898-1b8c-4dd4-bde7-10a84e5a6c81 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:00.739058 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-ab7c996b-68b8-401c-b4d8-0988eaf7d5a5 req-8472f898-1b8c-4dd4-bde7-10a84e5a6c81 service nova] Creating event network-vif-deleted:1828c28e-1b8e-4663-b048-5918944a0b41 for instance 556949a2-ac97-40b2-9827-ffa317d3c2a1 on hv-cinder-85272 Aug 10 11:44:00.744898 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-ab7c996b-68b8-401c-b4d8-0988eaf7d5a5 req-8472f898-1b8c-4dd4-bde7-10a84e5a6c81 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033281 Aug 10 11:44:00.746107 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 479/956] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:44:00.962054 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f789464e-4757-4cfb-9790-e0b57fd16a3f tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:00.962832 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-f789464e-4757-4cfb-9790-e0b57fd16a3f tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:00.969065 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f789464e-4757-4cfb-9790-e0b57fd16a3f tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:00.969548 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f789464e-4757-4cfb-9790-e0b57fd16a3f tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:00.970268 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f789464e-4757-4cfb-9790-e0b57fd16a3f tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:00.973387 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f789464e-4757-4cfb-9790-e0b57fd16a3f tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:00.973913 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f789464e-4757-4cfb-9790-e0b57fd16a3f tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:00.974361 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f789464e-4757-4cfb-9790-e0b57fd16a3f tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:01.124775 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-f789464e-4757-4cfb-9790-e0b57fd16a3f tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c1ca0941b2455995640460a2027f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d656a5891ea40268b8be271b4cc7aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:44:01.133675 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-f789464e-4757-4cfb-9790-e0b57fd16a3f tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9" status: 200 len: 1521 microversion: 2.1 time: 0.175556 Aug 10 11:44:01.134258 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 478/957] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:44:00 2022] GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:44:01.718431 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-1d99721b-40b8-4cac-8198-ab6ea5839c15 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:01.719138 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-1d99721b-40b8-4cac-8198-ab6ea5839c15 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: 556949a2-ac97-40b2-9827-ffa317d3c2a1] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:01.726503 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1d99721b-40b8-4cac-8198-ab6ea5839c15 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:01.726981 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1d99721b-40b8-4cac-8198-ab6ea5839c15 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:01.727417 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1d99721b-40b8-4cac-8198-ab6ea5839c15 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:01.728144 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1d99721b-40b8-4cac-8198-ab6ea5839c15 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:01.728606 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1d99721b-40b8-4cac-8198-ab6ea5839c15 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:01.729033 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1d99721b-40b8-4cac-8198-ab6ea5839c15 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:01.742688 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.wsgi [None req-1d99721b-40b8-4cac-8198-ab6ea5839c15 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] HTTP exception thrown: Instance 556949a2-ac97-40b2-9827-ffa317d3c2a1 could not be found. Aug 10 11:44:01.744340 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-1d99721b-40b8-4cac-8198-ab6ea5839c15 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Request method failure captured: Aug 10 11:44:01.744340 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: request: GET /compute/v2.1/servers/556949a2-ac97-40b2-9827-ffa317d3c2a1 HTTP/1.1 Aug 10 11:44:01.744340 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Accept: application/json Aug 10 11:44:01.744340 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Aug 10 11:44:01.744340 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Connection: close Aug 10 11:44:01.744340 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Content-Length: 0 Aug 10 11:44:01.744340 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Content-Type: application/json Aug 10 11:44:01.744340 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Host: 10.222.0.62 Aug 10 11:44:01.744340 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Aug 10 11:44:01.744340 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.11 Aug 10 11:44:01.744340 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABi85j1Z_p4bHKfDtwCR5cI1vKkiUevZtLfKhR9gL2L4p6ZI7z3LVXhoVJRxMT9yim4mKqNT-79-8TxG-8rnVFFKy2oTj_gW51D7DVPA8mVxBXOeNjZ-pLCQGa21yrFE589EN2VLmuGuTme3GLbMFo9BJLvvm35OiLTdXNpruXqVvI3eZI Aug 10 11:44:01.744340 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Aug 10 11:44:01.744340 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Aug 10 11:44:01.744340 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Aug 10 11:44:01.744340 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Aug 10 11:44:01.744340 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Aug 10 11:44:01.744340 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Aug 10 11:44:01.744340 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Id: 1275e554301b4d019da34186581fc0da Aug 10 11:44:01.744340 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-AttachVolumeNegativeTest-1707340158 Aug 10 11:44:01.744340 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Role: member,reader Aug 10 11:44:01.744340 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Aug 10 11:44:01.746251 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1275e554301b4d019da34186581fc0da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1275e554301b4d019da34186581fc0da", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1275e554301b4d019da34186581fc0da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1275e554301b4d019da34186581fc0da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:44:01.746251 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-AttachVolumeNegativeTest-1707340158 Aug 10 11:44:01.746251 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant-Id: 1275e554301b4d019da34186581fc0da Aug 10 11:44:01.746251 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1707340158 Aug 10 11:44:01.746251 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User: tempest-AttachVolumeNegativeTest-1707340158-project Aug 10 11:44:01.746251 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Aug 10 11:44:01.746251 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Aug 10 11:44:01.746251 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Id: 4f61f9a578834243b0d11888c397deff Aug 10 11:44:01.746251 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-AttachVolumeNegativeTest-1707340158-project Aug 10 11:44:01.746251 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: method: > Aug 10 11:44:01.746251 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: exception: Instance 556949a2-ac97-40b2-9827-ffa317d3c2a1 could not be found. Aug 10 11:44:01.746251 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: action_args: {'id': '556949a2-ac97-40b2-9827-ffa317d3c2a1'} Aug 10 11:44:01.747405 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:44:01.747405 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:44:01.747405 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:44:01.747405 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:44:01.747405 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:44:01.747405 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:44:01.747405 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:44:01.747405 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:44:01.747405 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:44:01.747405 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:44:01.747405 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 556949a2-ac97-40b2-9827-ffa317d3c2a1 could not be found. Aug 10 11:44:01.747405 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:44:01.747405 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:44:01.747405 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:44:01.747405 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:44:01.747405 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:44:01.747405 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:44:01.747405 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:44:01.747405 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:44:01.747405 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:44:01.749039 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:44:01.749039 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:44:01.749039 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:44:01.749039 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:44:01.749039 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:44:01.749039 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:44:01.749039 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:44:01.749039 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 556949a2-ac97-40b2-9827-ffa317d3c2a1 could not be found. Aug 10 11:44:01.749039 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:44:01.749039 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:44:01.749039 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:44:01.749039 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:44:01.749039 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:44:01.749039 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:44:01.749039 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:44:01.749039 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:44:01.749039 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 556949a2-ac97-40b2-9827-ffa317d3c2a1 could not be found. Aug 10 11:44:01.749039 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:44:01.750576 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-1d99721b-40b8-4cac-8198-ab6ea5839c15 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Returning 404 to user: Instance 556949a2-ac97-40b2-9827-ffa317d3c2a1 could not be found. {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:44:01.750576 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-1d99721b-40b8-4cac-8198-ab6ea5839c15 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/556949a2-ac97-40b2-9827-ffa317d3c2a1" status: 404 len: 111 microversion: 2.1 time: 0.031587 Aug 10 11:44:01.750576 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 480/958] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:44:01 2022] GET /compute/v2.1/servers/556949a2-ac97-40b2-9827-ffa317d3c2a1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:44:01.755224 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-ce000359-9d0b-4ea6-b1ff-16cd15691b4e tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '.version_select at 0x7fb7cdb12160>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:01.821268 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-ce000359-9d0b-4ea6-b1ff-16cd15691b4e tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-773997084" status: 202 len: 0 microversion: 2.1 time: 0.069719 Aug 10 11:44:01.821782 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 479/959] 10.222.0.62 () {58 vars in 1218 bytes} [Wed Aug 10 11:44:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-773997084 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:44:02.155417 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-3ba058dd-0726-45d3-b89f-b5ac222e336c tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:02.155858 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-3ba058dd-0726-45d3-b89f-b5ac222e336c tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:02.162547 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3ba058dd-0726-45d3-b89f-b5ac222e336c tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:02.163046 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3ba058dd-0726-45d3-b89f-b5ac222e336c tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:02.163350 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3ba058dd-0726-45d3-b89f-b5ac222e336c tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:02.164278 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3ba058dd-0726-45d3-b89f-b5ac222e336c tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:02.165109 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3ba058dd-0726-45d3-b89f-b5ac222e336c tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:02.165698 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3ba058dd-0726-45d3-b89f-b5ac222e336c tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:02.399288 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-3ba058dd-0726-45d3-b89f-b5ac222e336c tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c1ca0941b2455995640460a2027f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d656a5891ea40268b8be271b4cc7aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:44:02.407408 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-3ba058dd-0726-45d3-b89f-b5ac222e336c tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9" status: 200 len: 1577 microversion: 2.1 time: 0.255959 Aug 10 11:44:02.408430 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 481/960] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:44:02 2022] GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9 => generated 1577 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:44:03.429586 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-19000ba2-e7af-4f2f-bc75-4d088186f442 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:03.430161 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-19000ba2-e7af-4f2f-bc75-4d088186f442 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:03.436950 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-19000ba2-e7af-4f2f-bc75-4d088186f442 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:03.437473 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-19000ba2-e7af-4f2f-bc75-4d088186f442 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:03.437902 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-19000ba2-e7af-4f2f-bc75-4d088186f442 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:03.438583 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-19000ba2-e7af-4f2f-bc75-4d088186f442 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:03.439063 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-19000ba2-e7af-4f2f-bc75-4d088186f442 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:03.439484 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-19000ba2-e7af-4f2f-bc75-4d088186f442 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:03.571639 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-19000ba2-e7af-4f2f-bc75-4d088186f442 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c1ca0941b2455995640460a2027f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d656a5891ea40268b8be271b4cc7aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:44:03.579291 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-19000ba2-e7af-4f2f-bc75-4d088186f442 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9" status: 200 len: 1577 microversion: 2.1 time: 0.154934 Aug 10 11:44:03.584274 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 480/961] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:44:03 2022] GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:44:04.234385 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-f8723c1a-9fe7-448b-b767-e4b6783d2953 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:04.234871 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-f8723c1a-9fe7-448b-b767-e4b6783d2953 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: 556949a2-ac97-40b2-9827-ffa317d3c2a1] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:04.241377 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f8723c1a-9fe7-448b-b767-e4b6783d2953 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:04.241851 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f8723c1a-9fe7-448b-b767-e4b6783d2953 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:04.242285 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f8723c1a-9fe7-448b-b767-e4b6783d2953 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:04.242973 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f8723c1a-9fe7-448b-b767-e4b6783d2953 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:04.243426 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f8723c1a-9fe7-448b-b767-e4b6783d2953 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:04.243851 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f8723c1a-9fe7-448b-b767-e4b6783d2953 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:04.257365 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.wsgi [None req-f8723c1a-9fe7-448b-b767-e4b6783d2953 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] HTTP exception thrown: Instance 556949a2-ac97-40b2-9827-ffa317d3c2a1 could not be found. Aug 10 11:44:04.258901 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-f8723c1a-9fe7-448b-b767-e4b6783d2953 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Request method failure captured: Aug 10 11:44:04.258901 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: request: DELETE /compute/v2.1/servers/556949a2-ac97-40b2-9827-ffa317d3c2a1 HTTP/1.1 Aug 10 11:44:04.258901 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Accept: application/json Aug 10 11:44:04.258901 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Aug 10 11:44:04.258901 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Connection: close Aug 10 11:44:04.258901 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Content-Length: 0 Aug 10 11:44:04.258901 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Content-Type: application/json Aug 10 11:44:04.258901 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Host: 10.222.0.62 Aug 10 11:44:04.258901 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Aug 10 11:44:04.258901 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.11 Aug 10 11:44:04.258901 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABi85j1Z_p4bHKfDtwCR5cI1vKkiUevZtLfKhR9gL2L4p6ZI7z3LVXhoVJRxMT9yim4mKqNT-79-8TxG-8rnVFFKy2oTj_gW51D7DVPA8mVxBXOeNjZ-pLCQGa21yrFE589EN2VLmuGuTme3GLbMFo9BJLvvm35OiLTdXNpruXqVvI3eZI Aug 10 11:44:04.258901 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Aug 10 11:44:04.258901 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Aug 10 11:44:04.258901 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Aug 10 11:44:04.258901 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Aug 10 11:44:04.258901 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Aug 10 11:44:04.258901 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Aug 10 11:44:04.258901 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Id: 1275e554301b4d019da34186581fc0da Aug 10 11:44:04.258901 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-AttachVolumeNegativeTest-1707340158 Aug 10 11:44:04.258901 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Role: member,reader Aug 10 11:44:04.258901 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Aug 10 11:44:04.260408 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1275e554301b4d019da34186581fc0da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1275e554301b4d019da34186581fc0da", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1275e554301b4d019da34186581fc0da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1275e554301b4d019da34186581fc0da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:44:04.260408 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-AttachVolumeNegativeTest-1707340158 Aug 10 11:44:04.260408 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant-Id: 1275e554301b4d019da34186581fc0da Aug 10 11:44:04.260408 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1707340158 Aug 10 11:44:04.260408 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User: tempest-AttachVolumeNegativeTest-1707340158-project Aug 10 11:44:04.260408 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Aug 10 11:44:04.260408 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Aug 10 11:44:04.260408 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Id: 4f61f9a578834243b0d11888c397deff Aug 10 11:44:04.260408 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-AttachVolumeNegativeTest-1707340158-project Aug 10 11:44:04.260408 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: method: > Aug 10 11:44:04.260408 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: exception: Instance 556949a2-ac97-40b2-9827-ffa317d3c2a1 could not be found. Aug 10 11:44:04.260408 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: action_args: {'id': '556949a2-ac97-40b2-9827-ffa317d3c2a1'} Aug 10 11:44:04.261321 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:44:04.261321 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:44:04.261321 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:44:04.261321 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:44:04.261321 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:44:04.261321 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:44:04.261321 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:44:04.261321 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:44:04.261321 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:44:04.261321 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:44:04.261321 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 556949a2-ac97-40b2-9827-ffa317d3c2a1 could not be found. Aug 10 11:44:04.261321 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:44:04.261321 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:44:04.261321 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:44:04.261321 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:44:04.261321 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:44:04.261321 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:44:04.261321 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:44:04.261321 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:44:04.261321 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:44:04.262901 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:44:04.262901 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 11:44:04.262901 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 11:44:04.262901 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 11:44:04.262901 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 11:44:04.262901 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:44:04.262901 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:44:04.262901 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:44:04.262901 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:44:04.262901 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 556949a2-ac97-40b2-9827-ffa317d3c2a1 could not be found. Aug 10 11:44:04.262901 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:44:04.262901 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:44:04.262901 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:44:04.262901 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:44:04.262901 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:44:04.262901 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:44:04.262901 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:44:04.262901 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:44:04.262901 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 556949a2-ac97-40b2-9827-ffa317d3c2a1 could not be found. Aug 10 11:44:04.262901 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:44:04.264608 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-f8723c1a-9fe7-448b-b767-e4b6783d2953 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Returning 404 to user: Instance 556949a2-ac97-40b2-9827-ffa317d3c2a1 could not be found. {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:44:04.264608 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-f8723c1a-9fe7-448b-b767-e4b6783d2953 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "DELETE /compute/v2.1/servers/556949a2-ac97-40b2-9827-ffa317d3c2a1" status: 404 len: 111 microversion: 2.1 time: 0.030301 Aug 10 11:44:04.264608 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 482/962] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 10 11:44:04 2022] DELETE /compute/v2.1/servers/556949a2-ac97-40b2-9827-ffa317d3c2a1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:44:04.268954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-77cee098-7652-4524-9d0a-531c6bffa71b tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:04.269575 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-77cee098-7652-4524-9d0a-531c6bffa71b tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: 556949a2-ac97-40b2-9827-ffa317d3c2a1] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:04.276337 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-77cee098-7652-4524-9d0a-531c6bffa71b tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:04.276821 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-77cee098-7652-4524-9d0a-531c6bffa71b tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:04.277261 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-77cee098-7652-4524-9d0a-531c6bffa71b tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:04.277953 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-77cee098-7652-4524-9d0a-531c6bffa71b tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:04.278412 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-77cee098-7652-4524-9d0a-531c6bffa71b tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:04.278844 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-77cee098-7652-4524-9d0a-531c6bffa71b tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:04.291844 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-77cee098-7652-4524-9d0a-531c6bffa71b tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] HTTP exception thrown: Instance 556949a2-ac97-40b2-9827-ffa317d3c2a1 could not be found. Aug 10 11:44:04.293504 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-77cee098-7652-4524-9d0a-531c6bffa71b tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Request method failure captured: Aug 10 11:44:04.293504 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: request: GET /compute/v2.1/servers/556949a2-ac97-40b2-9827-ffa317d3c2a1 HTTP/1.1 Aug 10 11:44:04.293504 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept: application/json Aug 10 11:44:04.293504 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Aug 10 11:44:04.293504 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Connection: close Aug 10 11:44:04.293504 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Length: 0 Aug 10 11:44:04.293504 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Type: application/json Aug 10 11:44:04.293504 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Host: 10.222.0.62 Aug 10 11:44:04.293504 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Aug 10 11:44:04.293504 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.11 Aug 10 11:44:04.293504 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABi85j1Z_p4bHKfDtwCR5cI1vKkiUevZtLfKhR9gL2L4p6ZI7z3LVXhoVJRxMT9yim4mKqNT-79-8TxG-8rnVFFKy2oTj_gW51D7DVPA8mVxBXOeNjZ-pLCQGa21yrFE589EN2VLmuGuTme3GLbMFo9BJLvvm35OiLTdXNpruXqVvI3eZI Aug 10 11:44:04.293504 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Aug 10 11:44:04.293504 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Aug 10 11:44:04.293504 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Aug 10 11:44:04.293504 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Aug 10 11:44:04.293504 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Aug 10 11:44:04.293504 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Aug 10 11:44:04.293504 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Id: 1275e554301b4d019da34186581fc0da Aug 10 11:44:04.293504 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-AttachVolumeNegativeTest-1707340158 Aug 10 11:44:04.293504 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Role: member,reader Aug 10 11:44:04.293504 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Aug 10 11:44:04.295183 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1275e554301b4d019da34186581fc0da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1275e554301b4d019da34186581fc0da", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1275e554301b4d019da34186581fc0da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1275e554301b4d019da34186581fc0da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:44:04.295183 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-AttachVolumeNegativeTest-1707340158 Aug 10 11:44:04.295183 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Id: 1275e554301b4d019da34186581fc0da Aug 10 11:44:04.295183 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1707340158 Aug 10 11:44:04.295183 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User: tempest-AttachVolumeNegativeTest-1707340158-project Aug 10 11:44:04.295183 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Aug 10 11:44:04.295183 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Aug 10 11:44:04.295183 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Id: 4f61f9a578834243b0d11888c397deff Aug 10 11:44:04.295183 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-AttachVolumeNegativeTest-1707340158-project Aug 10 11:44:04.295183 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: method: > Aug 10 11:44:04.295183 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: exception: Instance 556949a2-ac97-40b2-9827-ffa317d3c2a1 could not be found. Aug 10 11:44:04.295183 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: action_args: {'id': '556949a2-ac97-40b2-9827-ffa317d3c2a1'} Aug 10 11:44:04.296307 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:44:04.296307 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:44:04.296307 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:44:04.296307 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:44:04.296307 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:44:04.296307 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:44:04.296307 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:44:04.296307 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:44:04.296307 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:44:04.296307 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:44:04.296307 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 556949a2-ac97-40b2-9827-ffa317d3c2a1 could not be found. Aug 10 11:44:04.296307 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:44:04.296307 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:44:04.296307 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:44:04.296307 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:44:04.296307 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:44:04.296307 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:44:04.296307 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:44:04.296307 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:44:04.296307 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:44:04.297847 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:44:04.297847 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:44:04.297847 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:44:04.297847 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:44:04.297847 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:44:04.297847 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:44:04.297847 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:44:04.297847 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 556949a2-ac97-40b2-9827-ffa317d3c2a1 could not be found. Aug 10 11:44:04.297847 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:44:04.297847 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:44:04.297847 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:44:04.297847 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:44:04.297847 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:44:04.297847 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:44:04.297847 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:44:04.297847 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:44:04.297847 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 556949a2-ac97-40b2-9827-ffa317d3c2a1 could not be found. Aug 10 11:44:04.297847 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:44:04.299336 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-77cee098-7652-4524-9d0a-531c6bffa71b tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Returning 404 to user: Instance 556949a2-ac97-40b2-9827-ffa317d3c2a1 could not be found. {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:44:04.299336 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-77cee098-7652-4524-9d0a-531c6bffa71b tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/556949a2-ac97-40b2-9827-ffa317d3c2a1" status: 404 len: 111 microversion: 2.1 time: 0.030116 Aug 10 11:44:04.299336 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 481/963] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:44:04 2022] GET /compute/v2.1/servers/556949a2-ac97-40b2-9827-ffa317d3c2a1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:44:04.599944 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-6dbe6dc0-55d0-4159-8d0c-aa5ba8714c9f tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:04.600597 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-6dbe6dc0-55d0-4159-8d0c-aa5ba8714c9f tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:04.606716 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6dbe6dc0-55d0-4159-8d0c-aa5ba8714c9f tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:04.607197 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6dbe6dc0-55d0-4159-8d0c-aa5ba8714c9f tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:04.607730 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6dbe6dc0-55d0-4159-8d0c-aa5ba8714c9f tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:04.608449 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6dbe6dc0-55d0-4159-8d0c-aa5ba8714c9f tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:04.608924 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6dbe6dc0-55d0-4159-8d0c-aa5ba8714c9f tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:04.609352 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6dbe6dc0-55d0-4159-8d0c-aa5ba8714c9f tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:04.742094 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-6dbe6dc0-55d0-4159-8d0c-aa5ba8714c9f tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c1ca0941b2455995640460a2027f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d656a5891ea40268b8be271b4cc7aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:44:04.750097 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-6dbe6dc0-55d0-4159-8d0c-aa5ba8714c9f tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9" status: 200 len: 1577 microversion: 2.1 time: 0.154418 Aug 10 11:44:04.754408 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 483/964] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:44:04 2022] GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:44:05.575720 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-5c18ccc5-bb3c-4f07-aa78-fa716b136ac9 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:05.576254 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-5c18ccc5-bb3c-4f07-aa78-fa716b136ac9 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: 068eca04-664e-4a6e-b2cb-23b0b980c8f3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:05.582743 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5c18ccc5-bb3c-4f07-aa78-fa716b136ac9 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:05.583224 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5c18ccc5-bb3c-4f07-aa78-fa716b136ac9 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:05.583774 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5c18ccc5-bb3c-4f07-aa78-fa716b136ac9 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:05.584590 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5c18ccc5-bb3c-4f07-aa78-fa716b136ac9 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:05.585043 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5c18ccc5-bb3c-4f07-aa78-fa716b136ac9 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:05.585473 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5c18ccc5-bb3c-4f07-aa78-fa716b136ac9 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:05.600016 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-5c18ccc5-bb3c-4f07-aa78-fa716b136ac9 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] HTTP exception thrown: Instance 068eca04-664e-4a6e-b2cb-23b0b980c8f3 could not be found. Aug 10 11:44:05.601557 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-5c18ccc5-bb3c-4f07-aa78-fa716b136ac9 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Request method failure captured: Aug 10 11:44:05.601557 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: request: DELETE /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3 HTTP/1.1 Aug 10 11:44:05.601557 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept: application/json Aug 10 11:44:05.601557 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Aug 10 11:44:05.601557 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Connection: close Aug 10 11:44:05.601557 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Length: 0 Aug 10 11:44:05.601557 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Type: application/json Aug 10 11:44:05.601557 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Host: 10.222.0.62 Aug 10 11:44:05.601557 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Aug 10 11:44:05.601557 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.11 Aug 10 11:44:05.601557 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABi85j1Z_p4bHKfDtwCR5cI1vKkiUevZtLfKhR9gL2L4p6ZI7z3LVXhoVJRxMT9yim4mKqNT-79-8TxG-8rnVFFKy2oTj_gW51D7DVPA8mVxBXOeNjZ-pLCQGa21yrFE589EN2VLmuGuTme3GLbMFo9BJLvvm35OiLTdXNpruXqVvI3eZI Aug 10 11:44:05.601557 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Aug 10 11:44:05.601557 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Aug 10 11:44:05.601557 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Aug 10 11:44:05.601557 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Aug 10 11:44:05.601557 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Aug 10 11:44:05.601557 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Aug 10 11:44:05.601557 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Id: 1275e554301b4d019da34186581fc0da Aug 10 11:44:05.601557 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-AttachVolumeNegativeTest-1707340158 Aug 10 11:44:05.601557 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Role: member,reader Aug 10 11:44:05.601557 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Aug 10 11:44:05.603212 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1275e554301b4d019da34186581fc0da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1275e554301b4d019da34186581fc0da", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1275e554301b4d019da34186581fc0da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1275e554301b4d019da34186581fc0da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:44:05.603212 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-AttachVolumeNegativeTest-1707340158 Aug 10 11:44:05.603212 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Id: 1275e554301b4d019da34186581fc0da Aug 10 11:44:05.603212 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1707340158 Aug 10 11:44:05.603212 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User: tempest-AttachVolumeNegativeTest-1707340158-project Aug 10 11:44:05.603212 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Aug 10 11:44:05.603212 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Aug 10 11:44:05.603212 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Id: 4f61f9a578834243b0d11888c397deff Aug 10 11:44:05.603212 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-AttachVolumeNegativeTest-1707340158-project Aug 10 11:44:05.603212 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: method: > Aug 10 11:44:05.603212 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: exception: Instance 068eca04-664e-4a6e-b2cb-23b0b980c8f3 could not be found. Aug 10 11:44:05.603212 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: action_args: {'id': '068eca04-664e-4a6e-b2cb-23b0b980c8f3'} Aug 10 11:44:05.604105 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:44:05.604105 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:44:05.604105 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:44:05.604105 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:44:05.604105 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:44:05.604105 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:44:05.604105 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:44:05.604105 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:44:05.604105 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:44:05.604105 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:44:05.604105 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 068eca04-664e-4a6e-b2cb-23b0b980c8f3 could not be found. Aug 10 11:44:05.604105 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:44:05.604105 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:44:05.604105 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:44:05.604105 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:44:05.604105 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:44:05.604105 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:44:05.604105 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:44:05.604105 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:44:05.604105 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:44:05.605390 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:44:05.605390 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 11:44:05.605390 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 11:44:05.605390 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 11:44:05.605390 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 11:44:05.605390 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:44:05.605390 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:44:05.605390 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:44:05.605390 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:44:05.605390 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 068eca04-664e-4a6e-b2cb-23b0b980c8f3 could not be found. Aug 10 11:44:05.605390 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:44:05.605390 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:44:05.605390 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:44:05.605390 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:44:05.605390 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:44:05.605390 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:44:05.605390 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:44:05.605390 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:44:05.605390 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 068eca04-664e-4a6e-b2cb-23b0b980c8f3 could not be found. Aug 10 11:44:05.605390 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:44:05.606743 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-5c18ccc5-bb3c-4f07-aa78-fa716b136ac9 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Returning 404 to user: Instance 068eca04-664e-4a6e-b2cb-23b0b980c8f3 could not be found. {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:44:05.606743 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-5c18ccc5-bb3c-4f07-aa78-fa716b136ac9 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "DELETE /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3" status: 404 len: 111 microversion: 2.1 time: 0.031035 Aug 10 11:44:05.606743 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 482/965] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 10 11:44:05 2022] DELETE /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:44:05.611254 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-94fc03f8-766c-4ef9-8c49-d43c82621eb2 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:05.611881 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-94fc03f8-766c-4ef9-8c49-d43c82621eb2 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: 068eca04-664e-4a6e-b2cb-23b0b980c8f3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:05.618937 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-94fc03f8-766c-4ef9-8c49-d43c82621eb2 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:05.619423 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-94fc03f8-766c-4ef9-8c49-d43c82621eb2 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:05.619863 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-94fc03f8-766c-4ef9-8c49-d43c82621eb2 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:05.620583 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-94fc03f8-766c-4ef9-8c49-d43c82621eb2 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:05.621045 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-94fc03f8-766c-4ef9-8c49-d43c82621eb2 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:05.621478 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-94fc03f8-766c-4ef9-8c49-d43c82621eb2 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:05.635227 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.wsgi [None req-94fc03f8-766c-4ef9-8c49-d43c82621eb2 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] HTTP exception thrown: Instance 068eca04-664e-4a6e-b2cb-23b0b980c8f3 could not be found. Aug 10 11:44:05.636821 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-94fc03f8-766c-4ef9-8c49-d43c82621eb2 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Request method failure captured: Aug 10 11:44:05.636821 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: request: GET /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3 HTTP/1.1 Aug 10 11:44:05.636821 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Accept: application/json Aug 10 11:44:05.636821 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Aug 10 11:44:05.636821 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Connection: close Aug 10 11:44:05.636821 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Content-Length: 0 Aug 10 11:44:05.636821 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Content-Type: application/json Aug 10 11:44:05.636821 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Host: 10.222.0.62 Aug 10 11:44:05.636821 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Aug 10 11:44:05.636821 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.11 Aug 10 11:44:05.636821 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABi85j1Z_p4bHKfDtwCR5cI1vKkiUevZtLfKhR9gL2L4p6ZI7z3LVXhoVJRxMT9yim4mKqNT-79-8TxG-8rnVFFKy2oTj_gW51D7DVPA8mVxBXOeNjZ-pLCQGa21yrFE589EN2VLmuGuTme3GLbMFo9BJLvvm35OiLTdXNpruXqVvI3eZI Aug 10 11:44:05.636821 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Aug 10 11:44:05.636821 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Aug 10 11:44:05.636821 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Aug 10 11:44:05.636821 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Aug 10 11:44:05.636821 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Aug 10 11:44:05.636821 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Aug 10 11:44:05.636821 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Id: 1275e554301b4d019da34186581fc0da Aug 10 11:44:05.636821 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-AttachVolumeNegativeTest-1707340158 Aug 10 11:44:05.636821 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Role: member,reader Aug 10 11:44:05.636821 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Aug 10 11:44:05.638536 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1275e554301b4d019da34186581fc0da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1275e554301b4d019da34186581fc0da", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1275e554301b4d019da34186581fc0da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1275e554301b4d019da34186581fc0da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:44:05.638536 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-AttachVolumeNegativeTest-1707340158 Aug 10 11:44:05.638536 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant-Id: 1275e554301b4d019da34186581fc0da Aug 10 11:44:05.638536 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1707340158 Aug 10 11:44:05.638536 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User: tempest-AttachVolumeNegativeTest-1707340158-project Aug 10 11:44:05.638536 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Aug 10 11:44:05.638536 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Aug 10 11:44:05.638536 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Id: 4f61f9a578834243b0d11888c397deff Aug 10 11:44:05.638536 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-AttachVolumeNegativeTest-1707340158-project Aug 10 11:44:05.638536 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: method: > Aug 10 11:44:05.638536 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: exception: Instance 068eca04-664e-4a6e-b2cb-23b0b980c8f3 could not be found. Aug 10 11:44:05.638536 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: action_args: {'id': '068eca04-664e-4a6e-b2cb-23b0b980c8f3'} Aug 10 11:44:05.639537 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:44:05.639537 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:44:05.639537 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:44:05.639537 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:44:05.639537 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:44:05.639537 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:44:05.639537 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:44:05.639537 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:44:05.639537 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:44:05.639537 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:44:05.639537 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 068eca04-664e-4a6e-b2cb-23b0b980c8f3 could not be found. Aug 10 11:44:05.639537 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:44:05.639537 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:44:05.639537 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:44:05.639537 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:44:05.639537 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:44:05.639537 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:44:05.639537 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:44:05.639537 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:44:05.639537 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:44:05.641408 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:44:05.641408 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:44:05.641408 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:44:05.641408 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:44:05.641408 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:44:05.641408 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:44:05.641408 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:44:05.641408 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 068eca04-664e-4a6e-b2cb-23b0b980c8f3 could not be found. Aug 10 11:44:05.641408 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:44:05.641408 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:44:05.641408 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:44:05.641408 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:44:05.641408 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:44:05.641408 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:44:05.641408 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:44:05.641408 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:44:05.641408 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 068eca04-664e-4a6e-b2cb-23b0b980c8f3 could not be found. Aug 10 11:44:05.641408 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:44:05.642927 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-94fc03f8-766c-4ef9-8c49-d43c82621eb2 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Returning 404 to user: Instance 068eca04-664e-4a6e-b2cb-23b0b980c8f3 could not be found. {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:44:05.642927 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-94fc03f8-766c-4ef9-8c49-d43c82621eb2 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3" status: 404 len: 111 microversion: 2.1 time: 0.030793 Aug 10 11:44:05.642927 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 484/966] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:44:05 2022] GET /compute/v2.1/servers/068eca04-664e-4a6e-b2cb-23b0b980c8f3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:44:05.646954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f089ea84-c773-42b9-8e84-16bb42fa9765 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:05.647462 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-f089ea84-c773-42b9-8e84-16bb42fa9765 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: aa5d857b-b50d-4b03-aadb-a4072d4c1d3e] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:05.653323 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f089ea84-c773-42b9-8e84-16bb42fa9765 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:05.653808 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f089ea84-c773-42b9-8e84-16bb42fa9765 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:05.654249 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f089ea84-c773-42b9-8e84-16bb42fa9765 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:05.654939 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f089ea84-c773-42b9-8e84-16bb42fa9765 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:05.655398 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f089ea84-c773-42b9-8e84-16bb42fa9765 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:05.655837 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f089ea84-c773-42b9-8e84-16bb42fa9765 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:05.669501 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-f089ea84-c773-42b9-8e84-16bb42fa9765 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] HTTP exception thrown: Instance aa5d857b-b50d-4b03-aadb-a4072d4c1d3e could not be found. Aug 10 11:44:05.671055 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f089ea84-c773-42b9-8e84-16bb42fa9765 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Request method failure captured: Aug 10 11:44:05.671055 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: request: DELETE /compute/v2.1/servers/aa5d857b-b50d-4b03-aadb-a4072d4c1d3e HTTP/1.1 Aug 10 11:44:05.671055 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept: application/json Aug 10 11:44:05.671055 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Aug 10 11:44:05.671055 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Connection: close Aug 10 11:44:05.671055 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Length: 0 Aug 10 11:44:05.671055 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Type: application/json Aug 10 11:44:05.671055 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Host: 10.222.0.62 Aug 10 11:44:05.671055 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Aug 10 11:44:05.671055 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.11 Aug 10 11:44:05.671055 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABi85j1Z_p4bHKfDtwCR5cI1vKkiUevZtLfKhR9gL2L4p6ZI7z3LVXhoVJRxMT9yim4mKqNT-79-8TxG-8rnVFFKy2oTj_gW51D7DVPA8mVxBXOeNjZ-pLCQGa21yrFE589EN2VLmuGuTme3GLbMFo9BJLvvm35OiLTdXNpruXqVvI3eZI Aug 10 11:44:05.671055 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Aug 10 11:44:05.671055 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Aug 10 11:44:05.671055 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Aug 10 11:44:05.671055 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Aug 10 11:44:05.671055 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Aug 10 11:44:05.671055 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Aug 10 11:44:05.671055 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Id: 1275e554301b4d019da34186581fc0da Aug 10 11:44:05.671055 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-AttachVolumeNegativeTest-1707340158 Aug 10 11:44:05.671055 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Role: member,reader Aug 10 11:44:05.671055 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Aug 10 11:44:05.673093 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1275e554301b4d019da34186581fc0da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1275e554301b4d019da34186581fc0da", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1275e554301b4d019da34186581fc0da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1275e554301b4d019da34186581fc0da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:44:05.673093 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-AttachVolumeNegativeTest-1707340158 Aug 10 11:44:05.673093 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Id: 1275e554301b4d019da34186581fc0da Aug 10 11:44:05.673093 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1707340158 Aug 10 11:44:05.673093 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User: tempest-AttachVolumeNegativeTest-1707340158-project Aug 10 11:44:05.673093 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Aug 10 11:44:05.673093 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Aug 10 11:44:05.673093 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Id: 4f61f9a578834243b0d11888c397deff Aug 10 11:44:05.673093 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-AttachVolumeNegativeTest-1707340158-project Aug 10 11:44:05.673093 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: method: > Aug 10 11:44:05.673093 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: exception: Instance aa5d857b-b50d-4b03-aadb-a4072d4c1d3e could not be found. Aug 10 11:44:05.673093 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: action_args: {'id': 'aa5d857b-b50d-4b03-aadb-a4072d4c1d3e'} Aug 10 11:44:05.675096 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:44:05.675096 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:44:05.675096 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:44:05.675096 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:44:05.675096 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:44:05.675096 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:44:05.675096 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:44:05.675096 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:44:05.675096 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:44:05.675096 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:44:05.675096 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa5d857b-b50d-4b03-aadb-a4072d4c1d3e could not be found. Aug 10 11:44:05.675096 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:44:05.675096 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:44:05.675096 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:44:05.675096 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:44:05.675096 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:44:05.675096 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:44:05.675096 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:44:05.675096 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:44:05.675096 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:44:05.676680 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:44:05.676680 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 11:44:05.676680 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 11:44:05.676680 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 11:44:05.676680 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 11:44:05.676680 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:44:05.676680 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:44:05.676680 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:44:05.676680 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:44:05.676680 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa5d857b-b50d-4b03-aadb-a4072d4c1d3e could not be found. Aug 10 11:44:05.676680 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:44:05.676680 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:44:05.676680 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:44:05.676680 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:44:05.676680 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:44:05.676680 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:44:05.676680 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:44:05.676680 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:44:05.676680 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa5d857b-b50d-4b03-aadb-a4072d4c1d3e could not be found. Aug 10 11:44:05.676680 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:44:05.678845 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f089ea84-c773-42b9-8e84-16bb42fa9765 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Returning 404 to user: Instance aa5d857b-b50d-4b03-aadb-a4072d4c1d3e could not be found. {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:44:05.678845 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-f089ea84-c773-42b9-8e84-16bb42fa9765 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "DELETE /compute/v2.1/servers/aa5d857b-b50d-4b03-aadb-a4072d4c1d3e" status: 404 len: 111 microversion: 2.1 time: 0.029499 Aug 10 11:44:05.678845 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 483/967] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 10 11:44:05 2022] DELETE /compute/v2.1/servers/aa5d857b-b50d-4b03-aadb-a4072d4c1d3e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:44:05.683399 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-2eb09322-affc-41cd-ab80-0215d50def84 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:05.684058 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-2eb09322-affc-41cd-ab80-0215d50def84 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: aa5d857b-b50d-4b03-aadb-a4072d4c1d3e] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:05.690053 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2eb09322-affc-41cd-ab80-0215d50def84 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:05.690538 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2eb09322-affc-41cd-ab80-0215d50def84 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:05.690978 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2eb09322-affc-41cd-ab80-0215d50def84 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:05.691692 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2eb09322-affc-41cd-ab80-0215d50def84 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:05.692188 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2eb09322-affc-41cd-ab80-0215d50def84 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:05.692623 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2eb09322-affc-41cd-ab80-0215d50def84 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:05.706689 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.wsgi [None req-2eb09322-affc-41cd-ab80-0215d50def84 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] HTTP exception thrown: Instance aa5d857b-b50d-4b03-aadb-a4072d4c1d3e could not be found. Aug 10 11:44:05.708262 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-2eb09322-affc-41cd-ab80-0215d50def84 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Request method failure captured: Aug 10 11:44:05.708262 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: request: GET /compute/v2.1/servers/aa5d857b-b50d-4b03-aadb-a4072d4c1d3e HTTP/1.1 Aug 10 11:44:05.708262 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Accept: application/json Aug 10 11:44:05.708262 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Aug 10 11:44:05.708262 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Connection: close Aug 10 11:44:05.708262 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Content-Length: 0 Aug 10 11:44:05.708262 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Content-Type: application/json Aug 10 11:44:05.708262 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Host: 10.222.0.62 Aug 10 11:44:05.708262 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Aug 10 11:44:05.708262 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.11 Aug 10 11:44:05.708262 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABi85j1Z_p4bHKfDtwCR5cI1vKkiUevZtLfKhR9gL2L4p6ZI7z3LVXhoVJRxMT9yim4mKqNT-79-8TxG-8rnVFFKy2oTj_gW51D7DVPA8mVxBXOeNjZ-pLCQGa21yrFE589EN2VLmuGuTme3GLbMFo9BJLvvm35OiLTdXNpruXqVvI3eZI Aug 10 11:44:05.708262 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Aug 10 11:44:05.708262 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Aug 10 11:44:05.708262 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Aug 10 11:44:05.708262 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Aug 10 11:44:05.708262 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Aug 10 11:44:05.708262 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Aug 10 11:44:05.708262 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Id: 1275e554301b4d019da34186581fc0da Aug 10 11:44:05.708262 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-AttachVolumeNegativeTest-1707340158 Aug 10 11:44:05.708262 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Role: member,reader Aug 10 11:44:05.708262 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Aug 10 11:44:05.710287 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1275e554301b4d019da34186581fc0da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1275e554301b4d019da34186581fc0da", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1275e554301b4d019da34186581fc0da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1275e554301b4d019da34186581fc0da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:44:05.710287 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-AttachVolumeNegativeTest-1707340158 Aug 10 11:44:05.710287 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant-Id: 1275e554301b4d019da34186581fc0da Aug 10 11:44:05.710287 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1707340158 Aug 10 11:44:05.710287 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User: tempest-AttachVolumeNegativeTest-1707340158-project Aug 10 11:44:05.710287 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Aug 10 11:44:05.710287 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Aug 10 11:44:05.710287 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Id: 4f61f9a578834243b0d11888c397deff Aug 10 11:44:05.710287 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-AttachVolumeNegativeTest-1707340158-project Aug 10 11:44:05.710287 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: method: > Aug 10 11:44:05.710287 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: exception: Instance aa5d857b-b50d-4b03-aadb-a4072d4c1d3e could not be found. Aug 10 11:44:05.710287 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: action_args: {'id': 'aa5d857b-b50d-4b03-aadb-a4072d4c1d3e'} Aug 10 11:44:05.711291 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:44:05.711291 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:44:05.711291 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:44:05.711291 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:44:05.711291 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:44:05.711291 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:44:05.711291 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:44:05.711291 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:44:05.711291 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:44:05.711291 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:44:05.711291 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa5d857b-b50d-4b03-aadb-a4072d4c1d3e could not be found. Aug 10 11:44:05.711291 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:44:05.711291 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:44:05.711291 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:44:05.711291 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:44:05.711291 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:44:05.711291 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:44:05.711291 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:44:05.711291 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:44:05.711291 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:44:05.712912 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:44:05.712912 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:44:05.712912 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:44:05.712912 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:44:05.712912 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:44:05.712912 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:44:05.712912 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:44:05.712912 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa5d857b-b50d-4b03-aadb-a4072d4c1d3e could not be found. Aug 10 11:44:05.712912 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:44:05.712912 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:44:05.712912 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:44:05.712912 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:44:05.712912 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:44:05.712912 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:44:05.712912 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:44:05.712912 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:44:05.712912 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa5d857b-b50d-4b03-aadb-a4072d4c1d3e could not be found. Aug 10 11:44:05.712912 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:44:05.714431 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-2eb09322-affc-41cd-ab80-0215d50def84 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Returning 404 to user: Instance aa5d857b-b50d-4b03-aadb-a4072d4c1d3e could not be found. {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:44:05.714431 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-2eb09322-affc-41cd-ab80-0215d50def84 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/aa5d857b-b50d-4b03-aadb-a4072d4c1d3e" status: 404 len: 111 microversion: 2.1 time: 0.030486 Aug 10 11:44:05.714431 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 485/968] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:44:05 2022] GET /compute/v2.1/servers/aa5d857b-b50d-4b03-aadb-a4072d4c1d3e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:44:05.771913 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-965e7ae0-fcc3-4f3f-9965-e3921a7a38ac tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:05.772553 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-965e7ae0-fcc3-4f3f-9965-e3921a7a38ac tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:05.778556 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-965e7ae0-fcc3-4f3f-9965-e3921a7a38ac tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:05.779091 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-965e7ae0-fcc3-4f3f-9965-e3921a7a38ac tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:05.779525 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-965e7ae0-fcc3-4f3f-9965-e3921a7a38ac tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:05.780233 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-965e7ae0-fcc3-4f3f-9965-e3921a7a38ac tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:05.780696 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-965e7ae0-fcc3-4f3f-9965-e3921a7a38ac tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:05.781125 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-965e7ae0-fcc3-4f3f-9965-e3921a7a38ac tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:05.916411 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-965e7ae0-fcc3-4f3f-9965-e3921a7a38ac tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c1ca0941b2455995640460a2027f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d656a5891ea40268b8be271b4cc7aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:44:05.923838 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-965e7ae0-fcc3-4f3f-9965-e3921a7a38ac tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9" status: 200 len: 1577 microversion: 2.1 time: 0.155810 Aug 10 11:44:05.924425 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 484/969] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:44:05 2022] GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:44:06.946642 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-7b4b12df-3d8a-4876-a56d-39a83e61bd89 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:06.947252 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-7b4b12df-3d8a-4876-a56d-39a83e61bd89 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:06.953835 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7b4b12df-3d8a-4876-a56d-39a83e61bd89 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:06.959695 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7b4b12df-3d8a-4876-a56d-39a83e61bd89 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:06.959695 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7b4b12df-3d8a-4876-a56d-39a83e61bd89 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:06.959695 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7b4b12df-3d8a-4876-a56d-39a83e61bd89 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:06.959695 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7b4b12df-3d8a-4876-a56d-39a83e61bd89 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:06.960167 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7b4b12df-3d8a-4876-a56d-39a83e61bd89 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:07.029275 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-39e2b4d4-0ee9-4148-be56-4d61ca3be203 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:07.029782 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-39e2b4d4-0ee9-4148-be56-4d61ca3be203 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:07.036532 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-39e2b4d4-0ee9-4148-be56-4d61ca3be203 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:07.037089 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-39e2b4d4-0ee9-4148-be56-4d61ca3be203 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:07.037625 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-39e2b4d4-0ee9-4148-be56-4d61ca3be203 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:07.038472 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-39e2b4d4-0ee9-4148-be56-4d61ca3be203 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:07.039004 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-39e2b4d4-0ee9-4148-be56-4d61ca3be203 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:07.039494 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-39e2b4d4-0ee9-4148-be56-4d61ca3be203 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:07.054003 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-39e2b4d4-0ee9-4148-be56-4d61ca3be203 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] HTTP exception thrown: Instance f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b could not be found. Aug 10 11:44:07.055681 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-39e2b4d4-0ee9-4148-be56-4d61ca3be203 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Request method failure captured: Aug 10 11:44:07.055681 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: request: DELETE /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b HTTP/1.1 Aug 10 11:44:07.055681 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept: application/json Aug 10 11:44:07.055681 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Aug 10 11:44:07.055681 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Connection: close Aug 10 11:44:07.055681 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Length: 0 Aug 10 11:44:07.055681 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Type: application/json Aug 10 11:44:07.055681 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Host: 10.222.0.62 Aug 10 11:44:07.055681 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Aug 10 11:44:07.055681 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.11 Aug 10 11:44:07.055681 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABi85j1Z_p4bHKfDtwCR5cI1vKkiUevZtLfKhR9gL2L4p6ZI7z3LVXhoVJRxMT9yim4mKqNT-79-8TxG-8rnVFFKy2oTj_gW51D7DVPA8mVxBXOeNjZ-pLCQGa21yrFE589EN2VLmuGuTme3GLbMFo9BJLvvm35OiLTdXNpruXqVvI3eZI Aug 10 11:44:07.055681 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Aug 10 11:44:07.055681 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Aug 10 11:44:07.055681 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Aug 10 11:44:07.055681 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Aug 10 11:44:07.055681 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Aug 10 11:44:07.055681 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Aug 10 11:44:07.055681 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Id: 1275e554301b4d019da34186581fc0da Aug 10 11:44:07.055681 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-AttachVolumeNegativeTest-1707340158 Aug 10 11:44:07.055681 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Role: member,reader Aug 10 11:44:07.055681 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Aug 10 11:44:07.057261 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1275e554301b4d019da34186581fc0da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1275e554301b4d019da34186581fc0da", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1275e554301b4d019da34186581fc0da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1275e554301b4d019da34186581fc0da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:44:07.057261 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-AttachVolumeNegativeTest-1707340158 Aug 10 11:44:07.057261 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Id: 1275e554301b4d019da34186581fc0da Aug 10 11:44:07.057261 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1707340158 Aug 10 11:44:07.057261 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User: tempest-AttachVolumeNegativeTest-1707340158-project Aug 10 11:44:07.057261 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Aug 10 11:44:07.057261 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Aug 10 11:44:07.057261 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Id: 4f61f9a578834243b0d11888c397deff Aug 10 11:44:07.057261 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-AttachVolumeNegativeTest-1707340158-project Aug 10 11:44:07.057261 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: method: > Aug 10 11:44:07.057261 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: exception: Instance f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b could not be found. Aug 10 11:44:07.057261 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: action_args: {'id': 'f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b'} Aug 10 11:44:07.058052 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:44:07.058052 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:44:07.058052 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:44:07.058052 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:44:07.058052 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:44:07.058052 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:44:07.058052 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:44:07.058052 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:44:07.058052 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:44:07.058052 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:44:07.058052 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b could not be found. Aug 10 11:44:07.058052 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:44:07.058052 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:44:07.058052 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:44:07.058052 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:44:07.058052 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:44:07.058052 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:44:07.058052 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:44:07.058052 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:44:07.058052 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:44:07.059679 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:44:07.059679 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 11:44:07.059679 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 11:44:07.059679 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 11:44:07.059679 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 11:44:07.059679 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:44:07.059679 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:44:07.059679 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:44:07.059679 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:44:07.059679 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b could not be found. Aug 10 11:44:07.059679 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:44:07.059679 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:44:07.059679 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:44:07.059679 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:44:07.059679 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:44:07.059679 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:44:07.059679 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:44:07.059679 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:44:07.059679 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b could not be found. Aug 10 11:44:07.059679 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:44:07.061268 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-39e2b4d4-0ee9-4148-be56-4d61ca3be203 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Returning 404 to user: Instance f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b could not be found. {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:44:07.061268 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-39e2b4d4-0ee9-4148-be56-4d61ca3be203 tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "DELETE /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b" status: 404 len: 111 microversion: 2.1 time: 0.032197 Aug 10 11:44:07.061268 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 485/970] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 10 11:44:07 2022] DELETE /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:44:07.065690 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-0f96d52a-a8a3-4dc0-b144-5c94e334e31e tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:07.066369 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-0f96d52a-a8a3-4dc0-b144-5c94e334e31e tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] [instance: f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:07.072804 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0f96d52a-a8a3-4dc0-b144-5c94e334e31e tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:07.073285 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0f96d52a-a8a3-4dc0-b144-5c94e334e31e tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:07.073712 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0f96d52a-a8a3-4dc0-b144-5c94e334e31e tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:07.074401 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0f96d52a-a8a3-4dc0-b144-5c94e334e31e tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:07.074846 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0f96d52a-a8a3-4dc0-b144-5c94e334e31e tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:07.075268 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0f96d52a-a8a3-4dc0-b144-5c94e334e31e tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:07.088317 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-0f96d52a-a8a3-4dc0-b144-5c94e334e31e tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] HTTP exception thrown: Instance f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b could not be found. Aug 10 11:44:07.089911 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-0f96d52a-a8a3-4dc0-b144-5c94e334e31e tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Request method failure captured: Aug 10 11:44:07.089911 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: request: GET /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b HTTP/1.1 Aug 10 11:44:07.089911 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept: application/json Aug 10 11:44:07.089911 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Aug 10 11:44:07.089911 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Connection: close Aug 10 11:44:07.089911 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Length: 0 Aug 10 11:44:07.089911 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Type: application/json Aug 10 11:44:07.089911 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Host: 10.222.0.62 Aug 10 11:44:07.089911 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Aug 10 11:44:07.089911 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.11 Aug 10 11:44:07.089911 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABi85j1Z_p4bHKfDtwCR5cI1vKkiUevZtLfKhR9gL2L4p6ZI7z3LVXhoVJRxMT9yim4mKqNT-79-8TxG-8rnVFFKy2oTj_gW51D7DVPA8mVxBXOeNjZ-pLCQGa21yrFE589EN2VLmuGuTme3GLbMFo9BJLvvm35OiLTdXNpruXqVvI3eZI Aug 10 11:44:07.089911 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Aug 10 11:44:07.089911 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Aug 10 11:44:07.089911 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Aug 10 11:44:07.089911 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Aug 10 11:44:07.089911 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Aug 10 11:44:07.089911 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Aug 10 11:44:07.089911 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Id: 1275e554301b4d019da34186581fc0da Aug 10 11:44:07.089911 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-AttachVolumeNegativeTest-1707340158 Aug 10 11:44:07.089911 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Role: member,reader Aug 10 11:44:07.089911 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Aug 10 11:44:07.091608 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1275e554301b4d019da34186581fc0da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1275e554301b4d019da34186581fc0da", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1275e554301b4d019da34186581fc0da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1275e554301b4d019da34186581fc0da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:44:07.091608 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-AttachVolumeNegativeTest-1707340158 Aug 10 11:44:07.091608 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Id: 1275e554301b4d019da34186581fc0da Aug 10 11:44:07.091608 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1707340158 Aug 10 11:44:07.091608 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User: tempest-AttachVolumeNegativeTest-1707340158-project Aug 10 11:44:07.091608 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Aug 10 11:44:07.091608 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Aug 10 11:44:07.091608 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Id: 4f61f9a578834243b0d11888c397deff Aug 10 11:44:07.091608 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-AttachVolumeNegativeTest-1707340158-project Aug 10 11:44:07.091608 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: method: > Aug 10 11:44:07.091608 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: exception: Instance f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b could not be found. Aug 10 11:44:07.091608 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: action_args: {'id': 'f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b'} Aug 10 11:44:07.092805 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:44:07.092805 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:44:07.092805 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:44:07.092805 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:44:07.092805 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:44:07.092805 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:44:07.092805 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:44:07.092805 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:44:07.092805 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:44:07.092805 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:44:07.092805 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b could not be found. Aug 10 11:44:07.092805 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:44:07.092805 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:44:07.092805 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:44:07.092805 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:44:07.092805 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:44:07.092805 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:44:07.092805 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:44:07.092805 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:44:07.092805 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:44:07.094373 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:44:07.094373 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:44:07.094373 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:44:07.094373 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:44:07.094373 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:44:07.094373 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:44:07.094373 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:44:07.094373 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b could not be found. Aug 10 11:44:07.094373 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:44:07.094373 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:44:07.094373 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:44:07.094373 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:44:07.094373 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:44:07.094373 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:44:07.094373 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:44:07.094373 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:44:07.094373 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b could not be found. Aug 10 11:44:07.094373 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:44:07.095925 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-0f96d52a-a8a3-4dc0-b144-5c94e334e31e tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] Returning 404 to user: Instance f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b could not be found. {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:44:07.095925 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-0f96d52a-a8a3-4dc0-b144-5c94e334e31e tempest-AttachVolumeNegativeTest-1707340158 tempest-AttachVolumeNegativeTest-1707340158-project] 10.222.0.62 "GET /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b" status: 404 len: 111 microversion: 2.1 time: 0.029054 Aug 10 11:44:07.095925 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 486/971] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:44:07 2022] GET /compute/v2.1/servers/f3ee5abb-9ac4-4c5f-97b1-f3c9c2ae805b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 11:44:07.099060 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-7b4b12df-3d8a-4876-a56d-39a83e61bd89 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c1ca0941b2455995640460a2027f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d656a5891ea40268b8be271b4cc7aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:44:07.106785 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-7b4b12df-3d8a-4876-a56d-39a83e61bd89 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9" status: 200 len: 1577 microversion: 2.1 time: 0.164845 Aug 10 11:44:07.107352 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 486/972] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:44:06 2022] GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9 => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:44:08.127355 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f5390210-b39b-4f25-bc16-355f2031e6ca tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:08.128019 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-f5390210-b39b-4f25-bc16-355f2031e6ca tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:08.135365 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f5390210-b39b-4f25-bc16-355f2031e6ca tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:08.135884 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f5390210-b39b-4f25-bc16-355f2031e6ca tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:08.136518 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f5390210-b39b-4f25-bc16-355f2031e6ca tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:08.137436 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f5390210-b39b-4f25-bc16-355f2031e6ca tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:08.138054 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f5390210-b39b-4f25-bc16-355f2031e6ca tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:08.138885 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f5390210-b39b-4f25-bc16-355f2031e6ca tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:08.273599 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-f5390210-b39b-4f25-bc16-355f2031e6ca tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c1ca0941b2455995640460a2027f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d656a5891ea40268b8be271b4cc7aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:44:08.281375 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-f5390210-b39b-4f25-bc16-355f2031e6ca tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9" status: 200 len: 1577 microversion: 2.1 time: 0.157953 Aug 10 11:44:08.281941 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 487/973] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:44:08 2022] GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9 => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:44:09.303345 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-c691f292-3b00-49b7-ae8a-4e96fec53de9 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:09.303890 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-c691f292-3b00-49b7-ae8a-4e96fec53de9 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:09.310505 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c691f292-3b00-49b7-ae8a-4e96fec53de9 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:09.310985 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c691f292-3b00-49b7-ae8a-4e96fec53de9 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:09.311418 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c691f292-3b00-49b7-ae8a-4e96fec53de9 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:09.312132 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c691f292-3b00-49b7-ae8a-4e96fec53de9 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:09.312585 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c691f292-3b00-49b7-ae8a-4e96fec53de9 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:09.313009 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c691f292-3b00-49b7-ae8a-4e96fec53de9 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:09.444145 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c691f292-3b00-49b7-ae8a-4e96fec53de9 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c1ca0941b2455995640460a2027f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d656a5891ea40268b8be271b4cc7aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:44:09.451783 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-c691f292-3b00-49b7-ae8a-4e96fec53de9 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9" status: 200 len: 1577 microversion: 2.1 time: 0.152939 Aug 10 11:44:09.452382 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 487/974] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:44:09 2022] GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:44:10.476260 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-258a87af-7b4b-4da5-81d6-3b9e2d34ce00 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:10.476260 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-258a87af-7b4b-4da5-81d6-3b9e2d34ce00 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:10.485628 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:44:10.487213 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-258a87af-7b4b-4da5-81d6-3b9e2d34ce00 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:10.487702 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-258a87af-7b4b-4da5-81d6-3b9e2d34ce00 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:10.488166 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-258a87af-7b4b-4da5-81d6-3b9e2d34ce00 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:10.489640 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-258a87af-7b4b-4da5-81d6-3b9e2d34ce00 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:10.490363 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-258a87af-7b4b-4da5-81d6-3b9e2d34ce00 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:10.491081 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-258a87af-7b4b-4da5-81d6-3b9e2d34ce00 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:10.657743 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-258a87af-7b4b-4da5-81d6-3b9e2d34ce00 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c1ca0941b2455995640460a2027f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d656a5891ea40268b8be271b4cc7aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:44:10.665994 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-258a87af-7b4b-4da5-81d6-3b9e2d34ce00 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9" status: 200 len: 1577 microversion: 2.1 time: 0.196245 Aug 10 11:44:10.666559 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 488/975] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:44:10 2022] GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9 => generated 1577 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:44:11.686446 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-8a472c24-71b2-4e08-8ca2-d5743eb74b8b tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:11.687099 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-8a472c24-71b2-4e08-8ca2-d5743eb74b8b tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:11.689688 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:44:11.695180 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8a472c24-71b2-4e08-8ca2-d5743eb74b8b tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:11.695744 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8a472c24-71b2-4e08-8ca2-d5743eb74b8b tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:11.696165 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8a472c24-71b2-4e08-8ca2-d5743eb74b8b tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:11.703286 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8a472c24-71b2-4e08-8ca2-d5743eb74b8b tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:11.703286 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8a472c24-71b2-4e08-8ca2-d5743eb74b8b tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:11.703286 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8a472c24-71b2-4e08-8ca2-d5743eb74b8b tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:11.841234 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-8a472c24-71b2-4e08-8ca2-d5743eb74b8b tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c1ca0941b2455995640460a2027f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d656a5891ea40268b8be271b4cc7aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:44:11.849708 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-8a472c24-71b2-4e08-8ca2-d5743eb74b8b tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9" status: 200 len: 1577 microversion: 2.1 time: 0.166453 Aug 10 11:44:11.858257 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-4efd5491-d395-467e-8eaa-096bcbd67f73 req-b34c2357-fc6c-4312-a3fc-a1280c82c484 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dd20638-cdb6-4db7-a23e-c98c00e103d9", "name": "network-vif-plugged", "status": "completed", "tag": "2743679b-eeea-46d5-a860-adc80ef124b6"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:44:11.863675 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 488/976] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:44:11 2022] GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9 => generated 1577 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:44:11.871483 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-4efd5491-d395-467e-8eaa-096bcbd67f73 req-b34c2357-fc6c-4312-a3fc-a1280c82c484 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:11.871986 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-4efd5491-d395-467e-8eaa-096bcbd67f73 req-b34c2357-fc6c-4312-a3fc-a1280c82c484 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:11.872421 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-4efd5491-d395-467e-8eaa-096bcbd67f73 req-b34c2357-fc6c-4312-a3fc-a1280c82c484 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:11.883638 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-4efd5491-d395-467e-8eaa-096bcbd67f73 req-b34c2357-fc6c-4312-a3fc-a1280c82c484 service nova] Creating event network-vif-plugged:2743679b-eeea-46d5-a860-adc80ef124b6 for instance 2dd20638-cdb6-4db7-a23e-c98c00e103d9 on hv-cinder-85272 Aug 10 11:44:11.889006 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-4efd5491-d395-467e-8eaa-096bcbd67f73 req-b34c2357-fc6c-4312-a3fc-a1280c82c484 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037108 Aug 10 11:44:11.889956 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 489/977] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:44:12.390693 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-bd41988b-a782-4463-9626-1c097db1fcdf tempest-VolumesSnapshotsTestJSON-1119813040 tempest-VolumesSnapshotsTestJSON-1119813040-project] Action: 'create', calling method: .version_select at 0x7fb7ce4ba700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1525597238"}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:44:12.873105 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-cf188a1d-a26c-4a8a-b47e-9d2b3a96c30a tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:12.873803 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-cf188a1d-a26c-4a8a-b47e-9d2b3a96c30a tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:12.880079 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cf188a1d-a26c-4a8a-b47e-9d2b3a96c30a tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:12.881689 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cf188a1d-a26c-4a8a-b47e-9d2b3a96c30a tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:12.882128 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cf188a1d-a26c-4a8a-b47e-9d2b3a96c30a tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:12.882812 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cf188a1d-a26c-4a8a-b47e-9d2b3a96c30a tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:12.883263 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cf188a1d-a26c-4a8a-b47e-9d2b3a96c30a tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:12.883717 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cf188a1d-a26c-4a8a-b47e-9d2b3a96c30a tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:12.956365 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-bd41988b-a782-4463-9626-1c097db1fcdf tempest-VolumesSnapshotsTestJSON-1119813040 tempest-VolumesSnapshotsTestJSON-1119813040-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.678969 Aug 10 11:44:12.957000 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 489/978] 10.222.0.62 () {60 vars in 1155 bytes} [Wed Aug 10 11:44:12 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 680 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 10 11:44:12.969216 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-db9ab364-a4b8-4026-871c-51306f50099d tempest-VolumesSnapshotsTestJSON-1119813040 tempest-VolumesSnapshotsTestJSON-1119813040-project] Calling method '.version_select at 0x7fb7cdbdb8b0>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:13.020520 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-db9ab364-a4b8-4026-871c-51306f50099d tempest-VolumesSnapshotsTestJSON-1119813040 tempest-VolumesSnapshotsTestJSON-1119813040-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/9673af10-e3e3-40f6-9585-acc9eb7c3f18" status: 200 len: 345 microversion: 2.1 time: 0.055240 Aug 10 11:44:13.021320 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 490/979] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Aug 10 11:44:12 2022] GET /compute/v2.1/os-volumes/9673af10-e3e3-40f6-9585-acc9eb7c3f18 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:44:13.032536 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-cf188a1d-a26c-4a8a-b47e-9d2b3a96c30a tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c1ca0941b2455995640460a2027f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d656a5891ea40268b8be271b4cc7aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:44:13.041177 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-cf188a1d-a26c-4a8a-b47e-9d2b3a96c30a tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9" status: 200 len: 1577 microversion: 2.1 time: 0.172981 Aug 10 11:44:13.041883 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 490/980] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:44:12 2022] GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9 => generated 1577 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:44:14.035940 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-7c6e6b86-a41e-4461-9e22-f7de72bda8cc tempest-VolumesSnapshotsTestJSON-1119813040 tempest-VolumesSnapshotsTestJSON-1119813040-project] Calling method '.version_select at 0x7fb7cdbdb670>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:14.062303 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-033175d5-9681-4799-adf9-d373f5c7b7e2 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:14.063897 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-033175d5-9681-4799-adf9-d373f5c7b7e2 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:14.070484 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-033175d5-9681-4799-adf9-d373f5c7b7e2 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:14.071181 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-033175d5-9681-4799-adf9-d373f5c7b7e2 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:14.071620 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-033175d5-9681-4799-adf9-d373f5c7b7e2 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:14.072349 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-033175d5-9681-4799-adf9-d373f5c7b7e2 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:14.072811 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-033175d5-9681-4799-adf9-d373f5c7b7e2 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:14.073236 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-033175d5-9681-4799-adf9-d373f5c7b7e2 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:14.083074 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-7c6e6b86-a41e-4461-9e22-f7de72bda8cc tempest-VolumesSnapshotsTestJSON-1119813040 tempest-VolumesSnapshotsTestJSON-1119813040-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/9673af10-e3e3-40f6-9585-acc9eb7c3f18" status: 200 len: 346 microversion: 2.1 time: 0.052032 Aug 10 11:44:14.084945 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 491/981] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Aug 10 11:44:14 2022] GET /compute/v2.1/os-volumes/9673af10-e3e3-40f6-9585-acc9eb7c3f18 => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:44:14.109003 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-52f3c11d-759f-455f-9a58-bd2551d01019 tempest-VolumesSnapshotsTestJSON-1119813040 tempest-VolumesSnapshotsTestJSON-1119813040-project] Action: 'create', calling method: .version_select at 0x7fb7ce5a6430>, body: {"snapshot": {"volume_id": "9673af10-e3e3-40f6-9585-acc9eb7c3f18", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1836585097"}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:44:14.215207 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-033175d5-9681-4799-adf9-d373f5c7b7e2 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c1ca0941b2455995640460a2027f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d656a5891ea40268b8be271b4cc7aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:44:14.220133 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-033175d5-9681-4799-adf9-d373f5c7b7e2 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9" status: 200 len: 1564 microversion: 2.1 time: 0.161675 Aug 10 11:44:14.220634 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 491/982] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:44:14 2022] GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9 => generated 1564 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:44:14.552969 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-52f3c11d-759f-455f-9a58-bd2551d01019 tempest-VolumesSnapshotsTestJSON-1119813040 tempest-VolumesSnapshotsTestJSON-1119813040-project] 10.222.0.62 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.447159 Aug 10 11:44:14.553630 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 492/983] 10.222.0.62 () {60 vars in 1162 bytes} [Wed Aug 10 11:44:14 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:44:14.564551 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-cb432149-de33-4ee8-8c34-25e4ef06e98f tempest-VolumesSnapshotsTestJSON-1119813040 tempest-VolumesSnapshotsTestJSON-1119813040-project] Calling method '.version_select at 0x7fb7cdb4f160>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:14.595223 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-cb432149-de33-4ee8-8c34-25e4ef06e98f tempest-VolumesSnapshotsTestJSON-1119813040 tempest-VolumesSnapshotsTestJSON-1119813040-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/0bfa402d-28be-427a-b6fb-a3a2d199420f" status: 200 len: 287 microversion: 2.1 time: 0.034764 Aug 10 11:44:14.595781 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 492/984] 10.222.0.62 () {58 vars in 1251 bytes} [Wed Aug 10 11:44:14 2022] GET /compute/v2.1/os-snapshots/0bfa402d-28be-427a-b6fb-a3a2d199420f => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:44:14.606362 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-74ad3883-552d-42bb-a72e-7df338ff5c8e tempest-VolumesSnapshotsTestJSON-1119813040 tempest-VolumesSnapshotsTestJSON-1119813040-project] Calling method '.version_select at 0x7fb7ce4ba160>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:14.637945 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-74ad3883-552d-42bb-a72e-7df338ff5c8e tempest-VolumesSnapshotsTestJSON-1119813040 tempest-VolumesSnapshotsTestJSON-1119813040-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.035318 Aug 10 11:44:14.638519 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 493/985] 10.222.0.62 () {58 vars in 1140 bytes} [Wed Aug 10 11:44:14 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:44:14.650579 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-b715adec-986c-4537-97ce-63be01e7cd09 tempest-VolumesSnapshotsTestJSON-1119813040 tempest-VolumesSnapshotsTestJSON-1119813040-project] Calling method '.version_select at 0x7fb7cdb12550>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:14.682439 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-b715adec-986c-4537-97ce-63be01e7cd09 tempest-VolumesSnapshotsTestJSON-1119813040 tempest-VolumesSnapshotsTestJSON-1119813040-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/0bfa402d-28be-427a-b6fb-a3a2d199420f" status: 200 len: 287 microversion: 2.1 time: 0.033075 Aug 10 11:44:14.682439 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 493/986] 10.222.0.62 () {58 vars in 1251 bytes} [Wed Aug 10 11:44:14 2022] GET /compute/v2.1/os-snapshots/0bfa402d-28be-427a-b6fb-a3a2d199420f => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:44:15.694097 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-41f0083c-5b4e-4665-a72d-7f1201a74a98 tempest-VolumesSnapshotsTestJSON-1119813040 tempest-VolumesSnapshotsTestJSON-1119813040-project] Calling method '.version_select at 0x7fb7ce5a30d0>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:15.724366 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-41f0083c-5b4e-4665-a72d-7f1201a74a98 tempest-VolumesSnapshotsTestJSON-1119813040 tempest-VolumesSnapshotsTestJSON-1119813040-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/0bfa402d-28be-427a-b6fb-a3a2d199420f" status: 200 len: 287 microversion: 2.1 time: 0.034922 Aug 10 11:44:15.725028 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 494/987] 10.222.0.62 () {58 vars in 1251 bytes} [Wed Aug 10 11:44:15 2022] GET /compute/v2.1/os-snapshots/0bfa402d-28be-427a-b6fb-a3a2d199420f => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:44:16.737375 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-fdf20efe-7720-4e63-a553-df8c143266e3 tempest-VolumesSnapshotsTestJSON-1119813040 tempest-VolumesSnapshotsTestJSON-1119813040-project] Calling method '.version_select at 0x7fb7cde6e940>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:16.767335 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-fdf20efe-7720-4e63-a553-df8c143266e3 tempest-VolumesSnapshotsTestJSON-1119813040 tempest-VolumesSnapshotsTestJSON-1119813040-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/0bfa402d-28be-427a-b6fb-a3a2d199420f" status: 200 len: 287 microversion: 2.1 time: 0.034264 Aug 10 11:44:16.767871 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 494/988] 10.222.0.62 () {58 vars in 1251 bytes} [Wed Aug 10 11:44:16 2022] GET /compute/v2.1/os-snapshots/0bfa402d-28be-427a-b6fb-a3a2d199420f => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:44:17.781113 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-2e8f0875-03e6-48d3-8a0d-1b19636216d7 tempest-VolumesSnapshotsTestJSON-1119813040 tempest-VolumesSnapshotsTestJSON-1119813040-project] Calling method '.version_select at 0x7fb7ce4baee0>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:17.810174 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-2e8f0875-03e6-48d3-8a0d-1b19636216d7 tempest-VolumesSnapshotsTestJSON-1119813040 tempest-VolumesSnapshotsTestJSON-1119813040-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/0bfa402d-28be-427a-b6fb-a3a2d199420f" status: 200 len: 288 microversion: 2.1 time: 0.033415 Aug 10 11:44:17.810729 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 495/989] 10.222.0.62 () {58 vars in 1251 bytes} [Wed Aug 10 11:44:17 2022] GET /compute/v2.1/os-snapshots/0bfa402d-28be-427a-b6fb-a3a2d199420f => generated 288 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:44:17.822770 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-22d71b2c-2d7b-4c80-8ed3-884ae35c17a1 tempest-VolumesSnapshotsTestJSON-1119813040 tempest-VolumesSnapshotsTestJSON-1119813040-project] Calling method '.version_select at 0x7fb7cdbb70d0>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:17.948040 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-22d71b2c-2d7b-4c80-8ed3-884ae35c17a1 tempest-VolumesSnapshotsTestJSON-1119813040 tempest-VolumesSnapshotsTestJSON-1119813040-project] 10.222.0.62 "DELETE /compute/v2.1/os-snapshots/0bfa402d-28be-427a-b6fb-a3a2d199420f" status: 202 len: 0 microversion: 2.1 time: 0.130028 Aug 10 11:44:17.950382 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 495/990] 10.222.0.62 () {58 vars in 1254 bytes} [Wed Aug 10 11:44:17 2022] DELETE /compute/v2.1/os-snapshots/0bfa402d-28be-427a-b6fb-a3a2d199420f => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:44:17.957144 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-54363cc0-5c2e-4696-810f-3db0146b9c86 tempest-VolumesSnapshotsTestJSON-1119813040 tempest-VolumesSnapshotsTestJSON-1119813040-project] Calling method '.version_select at 0x7fb7ce690d30>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:17.986693 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-54363cc0-5c2e-4696-810f-3db0146b9c86 tempest-VolumesSnapshotsTestJSON-1119813040 tempest-VolumesSnapshotsTestJSON-1119813040-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/0bfa402d-28be-427a-b6fb-a3a2d199420f" status: 200 len: 287 microversion: 2.1 time: 0.033370 Aug 10 11:44:17.987255 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 496/991] 10.222.0.62 () {58 vars in 1251 bytes} [Wed Aug 10 11:44:17 2022] GET /compute/v2.1/os-snapshots/0bfa402d-28be-427a-b6fb-a3a2d199420f => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:44:19.000054 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-73111a2e-67d4-4995-862a-8ce0dcbbd5e3 tempest-VolumesSnapshotsTestJSON-1119813040 tempest-VolumesSnapshotsTestJSON-1119813040-project] Calling method '.version_select at 0x7fb7cde6e3a0>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:19.038272 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-73111a2e-67d4-4995-862a-8ce0dcbbd5e3 tempest-VolumesSnapshotsTestJSON-1119813040 tempest-VolumesSnapshotsTestJSON-1119813040-project] HTTP exception thrown: Snapshot 0bfa402d-28be-427a-b6fb-a3a2d199420f could not be found. Aug 10 11:44:19.038272 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-73111a2e-67d4-4995-862a-8ce0dcbbd5e3 tempest-VolumesSnapshotsTestJSON-1119813040 tempest-VolumesSnapshotsTestJSON-1119813040-project] Request method failure captured: Aug 10 11:44:19.038272 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: request: GET /compute/v2.1/os-snapshots/0bfa402d-28be-427a-b6fb-a3a2d199420f HTTP/1.1 Aug 10 11:44:19.038272 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept: application/json Aug 10 11:44:19.038272 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Aug 10 11:44:19.038272 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Connection: close Aug 10 11:44:19.038272 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Length: 0 Aug 10 11:44:19.038272 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Type: application/json Aug 10 11:44:19.038272 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Host: 10.222.0.62 Aug 10 11:44:19.038272 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Aug 10 11:44:19.038272 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.11 Aug 10 11:44:19.038272 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABi85oM5SxXCaRnQIkTVANbzHoAi8PxssOPim47Aq1gvecwSRnn196VKZzEZp3p_OvszBGpNKnTz-A2U2M0mTnffgDbYqD_4Supr0RdWmMRclOCSP23dk_h2ojwYcp5esiX6x3USS_f1nBR41PddE1d9wvbwOKY8dMcT5Qz5aGuA877na4 Aug 10 11:44:19.038272 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Aug 10 11:44:19.038272 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Aug 10 11:44:19.038272 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Aug 10 11:44:19.038272 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Aug 10 11:44:19.038272 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Aug 10 11:44:19.038272 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Aug 10 11:44:19.038272 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Id: 1544caa7df3c42088c167a780c6b4426 Aug 10 11:44:19.038272 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1119813040 Aug 10 11:44:19.038272 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Role: member,reader Aug 10 11:44:19.038272 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Aug 10 11:44:19.040133 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1544caa7df3c42088c167a780c6b4426"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1544caa7df3c42088c167a780c6b4426", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1544caa7df3c42088c167a780c6b4426"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1544caa7df3c42088c167a780c6b4426"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:44:19.040133 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1119813040 Aug 10 11:44:19.040133 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Id: 1544caa7df3c42088c167a780c6b4426 Aug 10 11:44:19.040133 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1119813040 Aug 10 11:44:19.040133 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User: tempest-VolumesSnapshotsTestJSON-1119813040-project Aug 10 11:44:19.040133 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Aug 10 11:44:19.040133 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Aug 10 11:44:19.040133 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Id: 6ab19bbd7e144f7ca51c7752b195f8d7 Aug 10 11:44:19.040133 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1119813040-project Aug 10 11:44:19.040133 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: method: Aug 10 11:44:19.040133 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: exception: Snapshot 0bfa402d-28be-427a-b6fb-a3a2d199420f could not be found. Aug 10 11:44:19.040133 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: action_args: {'id': '0bfa402d-28be-427a-b6fb-a3a2d199420f'} Aug 10 11:44:19.040133 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:44:19.041251 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:44:19.041251 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 10 11:44:19.041251 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 10 11:44:19.041251 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 10 11:44:19.041251 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 10 11:44:19.041251 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 10 11:44:19.041251 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 10 11:44:19.041251 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 11:44:19.041251 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 11:44:19.041251 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 11:44:19.041251 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 11:44:19.041251 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 11:44:19.041251 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 11:44:19.041251 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 11:44:19.041251 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 11:44:19.041251 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 0bfa402d-28be-427a-b6fb-a3a2d199420f could not be found. (HTTP 404) (Request-ID: req-6a21efe4-e2e0-4528-891f-10da0850a16a) Aug 10 11:44:19.041251 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:44:19.041251 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:44:19.042850 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:44:19.042850 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:44:19.042850 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 10 11:44:19.042850 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 10 11:44:19.042850 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 11:44:19.042850 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 11:44:19.042850 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 10 11:44:19.042850 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 10 11:44:19.042850 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 11:44:19.042850 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 11:44:19.042850 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 10 11:44:19.042850 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 10 11:44:19.042850 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 10 11:44:19.042850 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 10 11:44:19.042850 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 10 11:44:19.042850 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 10 11:44:19.042850 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 11:44:19.042850 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 11:44:19.042850 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 11:44:19.044341 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 11:44:19.044341 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 11:44:19.044341 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 11:44:19.044341 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 11:44:19.044341 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 11:44:19.044341 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 0bfa402d-28be-427a-b6fb-a3a2d199420f could not be found. Aug 10 11:44:19.044341 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:44:19.044341 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:44:19.044341 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:44:19.044341 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:44:19.044341 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:44:19.044341 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:44:19.044341 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:44:19.044341 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:44:19.044341 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 11:44:19.044341 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 11:44:19.044341 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:44:19.044341 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:44:19.044341 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 10 11:44:19.044341 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:44:19.046077 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 0bfa402d-28be-427a-b6fb-a3a2d199420f could not be found. Aug 10 11:44:19.046077 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:44:19.046077 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:44:19.046077 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:44:19.046077 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:44:19.046077 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:44:19.046077 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:44:19.046077 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:44:19.046077 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:44:19.046077 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 0bfa402d-28be-427a-b6fb-a3a2d199420f could not be found. Aug 10 11:44:19.046077 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:44:19.046077 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-73111a2e-67d4-4995-862a-8ce0dcbbd5e3 tempest-VolumesSnapshotsTestJSON-1119813040 tempest-VolumesSnapshotsTestJSON-1119813040-project] Returning 404 to user: Snapshot 0bfa402d-28be-427a-b6fb-a3a2d199420f could not be found. {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:44:19.046077 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-73111a2e-67d4-4995-862a-8ce0dcbbd5e3 tempest-VolumesSnapshotsTestJSON-1119813040 tempest-VolumesSnapshotsTestJSON-1119813040-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/0bfa402d-28be-427a-b6fb-a3a2d199420f" status: 404 len: 111 microversion: 2.1 time: 0.034066 Aug 10 11:44:19.047096 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 496/992] 10.222.0.62 () {58 vars in 1251 bytes} [Wed Aug 10 11:44:18 2022] GET /compute/v2.1/os-snapshots/0bfa402d-28be-427a-b6fb-a3a2d199420f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 11:44:19.047201 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-75bbdbe6-e76f-4c38-a8ff-74713e6b8ef6 tempest-VolumesSnapshotsTestJSON-1119813040 tempest-VolumesSnapshotsTestJSON-1119813040-project] Calling method '.version_select at 0x7fb7ce5a64c0>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:19.261708 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-75bbdbe6-e76f-4c38-a8ff-74713e6b8ef6 tempest-VolumesSnapshotsTestJSON-1119813040 tempest-VolumesSnapshotsTestJSON-1119813040-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/9673af10-e3e3-40f6-9585-acc9eb7c3f18" status: 202 len: 0 microversion: 2.1 time: 0.226953 Aug 10 11:44:19.262284 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 497/993] 10.222.0.62 () {58 vars in 1248 bytes} [Wed Aug 10 11:44:19 2022] DELETE /compute/v2.1/os-volumes/9673af10-e3e3-40f6-9585-acc9eb7c3f18 => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:44:19.272369 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-6f1779f2-c75b-47bd-9e30-3e426a325a44 tempest-VolumesSnapshotsTestJSON-1119813040 tempest-VolumesSnapshotsTestJSON-1119813040-project] Calling method '.version_select at 0x7fb7cdc37040>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:19.319203 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-6f1779f2-c75b-47bd-9e30-3e426a325a44 tempest-VolumesSnapshotsTestJSON-1119813040 tempest-VolumesSnapshotsTestJSON-1119813040-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/9673af10-e3e3-40f6-9585-acc9eb7c3f18" status: 200 len: 345 microversion: 2.1 time: 0.051989 Aug 10 11:44:19.319783 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 497/994] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Aug 10 11:44:19 2022] GET /compute/v2.1/os-volumes/9673af10-e3e3-40f6-9585-acc9eb7c3f18 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:44:20.334756 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-9ac766ce-118b-4275-9d44-8f511823470c tempest-VolumesSnapshotsTestJSON-1119813040 tempest-VolumesSnapshotsTestJSON-1119813040-project] Calling method '.version_select at 0x7fb7ce4bab80>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:20.361922 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.wsgi [None req-9ac766ce-118b-4275-9d44-8f511823470c tempest-VolumesSnapshotsTestJSON-1119813040 tempest-VolumesSnapshotsTestJSON-1119813040-project] HTTP exception thrown: Volume 9673af10-e3e3-40f6-9585-acc9eb7c3f18 could not be found. Aug 10 11:44:20.363923 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-9ac766ce-118b-4275-9d44-8f511823470c tempest-VolumesSnapshotsTestJSON-1119813040 tempest-VolumesSnapshotsTestJSON-1119813040-project] Request method failure captured: Aug 10 11:44:20.363923 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: request: GET /compute/v2.1/os-volumes/9673af10-e3e3-40f6-9585-acc9eb7c3f18 HTTP/1.1 Aug 10 11:44:20.363923 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Accept: application/json Aug 10 11:44:20.363923 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Aug 10 11:44:20.363923 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Connection: close Aug 10 11:44:20.363923 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Content-Length: 0 Aug 10 11:44:20.363923 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Content-Type: application/json Aug 10 11:44:20.363923 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Host: 10.222.0.62 Aug 10 11:44:20.363923 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Aug 10 11:44:20.363923 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.11 Aug 10 11:44:20.363923 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABi85oM5SxXCaRnQIkTVANbzHoAi8PxssOPim47Aq1gvecwSRnn196VKZzEZp3p_OvszBGpNKnTz-A2U2M0mTnffgDbYqD_4Supr0RdWmMRclOCSP23dk_h2ojwYcp5esiX6x3USS_f1nBR41PddE1d9wvbwOKY8dMcT5Qz5aGuA877na4 Aug 10 11:44:20.363923 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Aug 10 11:44:20.363923 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Aug 10 11:44:20.363923 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Aug 10 11:44:20.363923 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Aug 10 11:44:20.363923 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Aug 10 11:44:20.363923 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Aug 10 11:44:20.363923 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Id: 1544caa7df3c42088c167a780c6b4426 Aug 10 11:44:20.363923 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1119813040 Aug 10 11:44:20.363923 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Role: member,reader Aug 10 11:44:20.363923 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Aug 10 11:44:20.366008 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1544caa7df3c42088c167a780c6b4426"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1544caa7df3c42088c167a780c6b4426", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1544caa7df3c42088c167a780c6b4426"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1544caa7df3c42088c167a780c6b4426"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:44:20.366008 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1119813040 Aug 10 11:44:20.366008 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant-Id: 1544caa7df3c42088c167a780c6b4426 Aug 10 11:44:20.366008 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1119813040 Aug 10 11:44:20.366008 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User: tempest-VolumesSnapshotsTestJSON-1119813040-project Aug 10 11:44:20.366008 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Aug 10 11:44:20.366008 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Aug 10 11:44:20.366008 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Id: 6ab19bbd7e144f7ca51c7752b195f8d7 Aug 10 11:44:20.366008 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1119813040-project Aug 10 11:44:20.366008 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: method: Aug 10 11:44:20.366008 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: exception: Volume 9673af10-e3e3-40f6-9585-acc9eb7c3f18 could not be found. Aug 10 11:44:20.366008 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: action_args: {'id': '9673af10-e3e3-40f6-9585-acc9eb7c3f18'} Aug 10 11:44:20.366008 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:44:20.366922 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:44:20.366922 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 11:44:20.366922 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 11:44:20.366922 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 11:44:20.366922 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 11:44:20.366922 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 11:44:20.366922 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 11:44:20.366922 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 11:44:20.366922 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 11:44:20.366922 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 11:44:20.366922 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 11:44:20.366922 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 11:44:20.366922 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 11:44:20.366922 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 11:44:20.366922 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 11:44:20.366922 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9673af10-e3e3-40f6-9585-acc9eb7c3f18 could not be found. (HTTP 404) (Request-ID: req-97fa4d59-07b4-4e0c-9cad-30b81100f772) Aug 10 11:44:20.366922 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:44:20.366922 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:44:20.366922 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:44:20.368450 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:44:20.368450 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 11:44:20.368450 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 11:44:20.368450 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 11:44:20.368450 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 11:44:20.368450 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 11:44:20.368450 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 11:44:20.368450 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 11:44:20.368450 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 11:44:20.368450 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 11:44:20.368450 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 11:44:20.368450 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 11:44:20.368450 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 11:44:20.368450 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 11:44:20.368450 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 11:44:20.368450 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 11:44:20.368450 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 11:44:20.368450 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 11:44:20.368450 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 11:44:20.369922 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 11:44:20.369922 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 11:44:20.369922 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 11:44:20.369922 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 11:44:20.369922 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9673af10-e3e3-40f6-9585-acc9eb7c3f18 could not be found. Aug 10 11:44:20.369922 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:44:20.369922 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:44:20.369922 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:44:20.369922 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:44:20.369922 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:44:20.369922 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:44:20.369922 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:44:20.369922 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:44:20.369922 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 11:44:20.369922 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 11:44:20.369922 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:44:20.369922 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:44:20.369922 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 11:44:20.369922 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:44:20.371417 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9673af10-e3e3-40f6-9585-acc9eb7c3f18 could not be found. Aug 10 11:44:20.371417 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:44:20.371417 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:44:20.371417 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:44:20.371417 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:44:20.371417 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:44:20.371417 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:44:20.371417 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:44:20.371417 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:44:20.371417 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9673af10-e3e3-40f6-9585-acc9eb7c3f18 could not be found. Aug 10 11:44:20.371417 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:44:20.371417 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-9ac766ce-118b-4275-9d44-8f511823470c tempest-VolumesSnapshotsTestJSON-1119813040 tempest-VolumesSnapshotsTestJSON-1119813040-project] Returning 404 to user: Volume 9673af10-e3e3-40f6-9585-acc9eb7c3f18 could not be found. {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:44:20.371417 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-9ac766ce-118b-4275-9d44-8f511823470c tempest-VolumesSnapshotsTestJSON-1119813040 tempest-VolumesSnapshotsTestJSON-1119813040-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/9673af10-e3e3-40f6-9585-acc9eb7c3f18" status: 404 len: 109 microversion: 2.1 time: 0.036442 Aug 10 11:44:20.371417 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 498/995] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Aug 10 11:44:20 2022] GET /compute/v2.1/os-volumes/9673af10-e3e3-40f6-9585-acc9eb7c3f18 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:44:20.382905 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-80b126ef-ab95-4346-a699-ccf4dc1a187c tempest-VolumesSnapshotsTestJSON-1119813040 tempest-VolumesSnapshotsTestJSON-1119813040-project] Calling method '.version_select at 0x7fb7cdbb74c0>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:20.410204 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-80b126ef-ab95-4346-a699-ccf4dc1a187c tempest-VolumesSnapshotsTestJSON-1119813040 tempest-VolumesSnapshotsTestJSON-1119813040-project] HTTP exception thrown: Volume 9673af10-e3e3-40f6-9585-acc9eb7c3f18 could not be found. Aug 10 11:44:20.417100 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-80b126ef-ab95-4346-a699-ccf4dc1a187c tempest-VolumesSnapshotsTestJSON-1119813040 tempest-VolumesSnapshotsTestJSON-1119813040-project] Request method failure captured: Aug 10 11:44:20.417100 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: request: DELETE /compute/v2.1/os-volumes/9673af10-e3e3-40f6-9585-acc9eb7c3f18 HTTP/1.1 Aug 10 11:44:20.417100 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept: application/json Aug 10 11:44:20.417100 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Aug 10 11:44:20.417100 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Connection: close Aug 10 11:44:20.417100 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Length: 0 Aug 10 11:44:20.417100 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Type: application/json Aug 10 11:44:20.417100 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Host: 10.222.0.62 Aug 10 11:44:20.417100 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Aug 10 11:44:20.417100 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.11 Aug 10 11:44:20.417100 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABi85oM5SxXCaRnQIkTVANbzHoAi8PxssOPim47Aq1gvecwSRnn196VKZzEZp3p_OvszBGpNKnTz-A2U2M0mTnffgDbYqD_4Supr0RdWmMRclOCSP23dk_h2ojwYcp5esiX6x3USS_f1nBR41PddE1d9wvbwOKY8dMcT5Qz5aGuA877na4 Aug 10 11:44:20.417100 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Aug 10 11:44:20.417100 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Aug 10 11:44:20.417100 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Aug 10 11:44:20.417100 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Aug 10 11:44:20.417100 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Aug 10 11:44:20.417100 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Aug 10 11:44:20.417100 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Id: 1544caa7df3c42088c167a780c6b4426 Aug 10 11:44:20.417100 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1119813040 Aug 10 11:44:20.417100 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Role: member,reader Aug 10 11:44:20.417100 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Aug 10 11:44:20.418840 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1544caa7df3c42088c167a780c6b4426"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1544caa7df3c42088c167a780c6b4426", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1544caa7df3c42088c167a780c6b4426"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1544caa7df3c42088c167a780c6b4426"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:44:20.418840 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1119813040 Aug 10 11:44:20.418840 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Id: 1544caa7df3c42088c167a780c6b4426 Aug 10 11:44:20.418840 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1119813040 Aug 10 11:44:20.418840 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User: tempest-VolumesSnapshotsTestJSON-1119813040-project Aug 10 11:44:20.418840 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Aug 10 11:44:20.418840 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Aug 10 11:44:20.418840 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Id: 6ab19bbd7e144f7ca51c7752b195f8d7 Aug 10 11:44:20.418840 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1119813040-project Aug 10 11:44:20.418840 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: method: Aug 10 11:44:20.418840 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: exception: Volume 9673af10-e3e3-40f6-9585-acc9eb7c3f18 could not be found. Aug 10 11:44:20.418840 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: action_args: {'id': '9673af10-e3e3-40f6-9585-acc9eb7c3f18'} Aug 10 11:44:20.418840 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:44:20.419955 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:44:20.419955 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 11:44:20.419955 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 11:44:20.419955 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 11:44:20.419955 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 11:44:20.419955 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 11:44:20.419955 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 11:44:20.419955 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 11:44:20.419955 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 11:44:20.419955 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 11:44:20.419955 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 11:44:20.419955 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 11:44:20.419955 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 11:44:20.419955 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 11:44:20.419955 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 11:44:20.419955 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9673af10-e3e3-40f6-9585-acc9eb7c3f18 could not be found. (HTTP 404) (Request-ID: req-e079110f-8dac-4ed9-b3f3-c4d239438db7) Aug 10 11:44:20.419955 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:44:20.419955 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:44:20.419955 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:44:20.421464 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:44:20.421464 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 10 11:44:20.421464 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 10 11:44:20.421464 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 11:44:20.421464 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 11:44:20.421464 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 11:44:20.421464 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 11:44:20.421464 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 11:44:20.421464 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 11:44:20.421464 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 11:44:20.421464 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 11:44:20.421464 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 11:44:20.421464 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 11:44:20.421464 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 11:44:20.421464 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 11:44:20.421464 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 11:44:20.421464 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 11:44:20.421464 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 11:44:20.421464 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 11:44:20.422922 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 11:44:20.422922 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 11:44:20.422922 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 11:44:20.422922 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 11:44:20.422922 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9673af10-e3e3-40f6-9585-acc9eb7c3f18 could not be found. Aug 10 11:44:20.422922 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:44:20.422922 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:44:20.422922 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:44:20.422922 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:44:20.422922 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:44:20.422922 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:44:20.422922 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:44:20.422922 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:44:20.422922 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 11:44:20.422922 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 11:44:20.422922 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:44:20.422922 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:44:20.422922 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 10 11:44:20.422922 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:44:20.424533 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9673af10-e3e3-40f6-9585-acc9eb7c3f18 could not be found. Aug 10 11:44:20.424533 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:44:20.424533 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:44:20.424533 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:44:20.424533 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:44:20.424533 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:44:20.424533 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:44:20.424533 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:44:20.424533 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:44:20.424533 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9673af10-e3e3-40f6-9585-acc9eb7c3f18 could not be found. Aug 10 11:44:20.424533 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:44:20.424533 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-80b126ef-ab95-4346-a699-ccf4dc1a187c tempest-VolumesSnapshotsTestJSON-1119813040 tempest-VolumesSnapshotsTestJSON-1119813040-project] Returning 404 to user: Volume 9673af10-e3e3-40f6-9585-acc9eb7c3f18 could not be found. {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:44:20.424533 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-80b126ef-ab95-4346-a699-ccf4dc1a187c tempest-VolumesSnapshotsTestJSON-1119813040 tempest-VolumesSnapshotsTestJSON-1119813040-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/9673af10-e3e3-40f6-9585-acc9eb7c3f18" status: 404 len: 109 microversion: 2.1 time: 0.035701 Aug 10 11:44:20.424533 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 498/996] 10.222.0.62 () {58 vars in 1248 bytes} [Wed Aug 10 11:44:20 2022] DELETE /compute/v2.1/os-volumes/9673af10-e3e3-40f6-9585-acc9eb7c3f18 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:44:20.425675 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-f88af10e-88e9-425e-8491-6238407db6db tempest-VolumesSnapshotsTestJSON-1119813040 tempest-VolumesSnapshotsTestJSON-1119813040-project] Calling method '.version_select at 0x7fb7ce601700>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:20.455849 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.wsgi [None req-f88af10e-88e9-425e-8491-6238407db6db tempest-VolumesSnapshotsTestJSON-1119813040 tempest-VolumesSnapshotsTestJSON-1119813040-project] HTTP exception thrown: Volume 9673af10-e3e3-40f6-9585-acc9eb7c3f18 could not be found. Aug 10 11:44:20.458902 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-f88af10e-88e9-425e-8491-6238407db6db tempest-VolumesSnapshotsTestJSON-1119813040 tempest-VolumesSnapshotsTestJSON-1119813040-project] Request method failure captured: Aug 10 11:44:20.458902 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: request: GET /compute/v2.1/os-volumes/9673af10-e3e3-40f6-9585-acc9eb7c3f18 HTTP/1.1 Aug 10 11:44:20.458902 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Accept: application/json Aug 10 11:44:20.458902 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Aug 10 11:44:20.458902 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Connection: close Aug 10 11:44:20.458902 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Content-Length: 0 Aug 10 11:44:20.458902 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Content-Type: application/json Aug 10 11:44:20.458902 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Host: 10.222.0.62 Aug 10 11:44:20.458902 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Aug 10 11:44:20.458902 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.11 Aug 10 11:44:20.458902 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABi85oM5SxXCaRnQIkTVANbzHoAi8PxssOPim47Aq1gvecwSRnn196VKZzEZp3p_OvszBGpNKnTz-A2U2M0mTnffgDbYqD_4Supr0RdWmMRclOCSP23dk_h2ojwYcp5esiX6x3USS_f1nBR41PddE1d9wvbwOKY8dMcT5Qz5aGuA877na4 Aug 10 11:44:20.458902 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Aug 10 11:44:20.458902 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Aug 10 11:44:20.458902 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Aug 10 11:44:20.458902 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Aug 10 11:44:20.458902 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Aug 10 11:44:20.458902 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Aug 10 11:44:20.458902 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Id: 1544caa7df3c42088c167a780c6b4426 Aug 10 11:44:20.458902 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1119813040 Aug 10 11:44:20.458902 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Role: member,reader Aug 10 11:44:20.458902 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Aug 10 11:44:20.460626 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1544caa7df3c42088c167a780c6b4426"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1544caa7df3c42088c167a780c6b4426", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1544caa7df3c42088c167a780c6b4426"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1544caa7df3c42088c167a780c6b4426"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:44:20.460626 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1119813040 Aug 10 11:44:20.460626 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant-Id: 1544caa7df3c42088c167a780c6b4426 Aug 10 11:44:20.460626 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1119813040 Aug 10 11:44:20.460626 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User: tempest-VolumesSnapshotsTestJSON-1119813040-project Aug 10 11:44:20.460626 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Aug 10 11:44:20.460626 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Aug 10 11:44:20.460626 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Id: 6ab19bbd7e144f7ca51c7752b195f8d7 Aug 10 11:44:20.460626 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1119813040-project Aug 10 11:44:20.460626 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: method: Aug 10 11:44:20.460626 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: exception: Volume 9673af10-e3e3-40f6-9585-acc9eb7c3f18 could not be found. Aug 10 11:44:20.460626 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: action_args: {'id': '9673af10-e3e3-40f6-9585-acc9eb7c3f18'} Aug 10 11:44:20.460626 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:44:20.461735 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:44:20.461735 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 11:44:20.461735 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 11:44:20.461735 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 11:44:20.461735 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 11:44:20.461735 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 11:44:20.461735 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 11:44:20.461735 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 11:44:20.461735 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 11:44:20.461735 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 11:44:20.461735 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 11:44:20.461735 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 11:44:20.461735 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 11:44:20.461735 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 11:44:20.461735 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 11:44:20.461735 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9673af10-e3e3-40f6-9585-acc9eb7c3f18 could not be found. (HTTP 404) (Request-ID: req-a2ebc97e-cc02-462d-9b1d-9ef77b29acd9) Aug 10 11:44:20.461735 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:44:20.461735 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:44:20.461735 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:44:20.463155 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:44:20.463155 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 11:44:20.463155 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 11:44:20.463155 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 11:44:20.463155 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 11:44:20.463155 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 11:44:20.463155 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 11:44:20.463155 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 11:44:20.463155 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 11:44:20.463155 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 11:44:20.463155 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 11:44:20.463155 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 11:44:20.463155 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 11:44:20.463155 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 11:44:20.463155 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 11:44:20.463155 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 11:44:20.463155 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 11:44:20.463155 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 11:44:20.463155 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 11:44:20.464535 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 11:44:20.464535 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 11:44:20.464535 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 11:44:20.464535 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 11:44:20.464535 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9673af10-e3e3-40f6-9585-acc9eb7c3f18 could not be found. Aug 10 11:44:20.464535 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:44:20.464535 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:44:20.464535 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:44:20.464535 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:44:20.464535 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:44:20.464535 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:44:20.464535 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:44:20.464535 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:44:20.464535 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 11:44:20.464535 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 11:44:20.464535 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:44:20.464535 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:44:20.464535 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 11:44:20.464535 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:44:20.465947 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9673af10-e3e3-40f6-9585-acc9eb7c3f18 could not be found. Aug 10 11:44:20.465947 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:44:20.465947 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:44:20.465947 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:44:20.465947 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:44:20.465947 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:44:20.465947 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:44:20.465947 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:44:20.465947 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:44:20.465947 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9673af10-e3e3-40f6-9585-acc9eb7c3f18 could not be found. Aug 10 11:44:20.465947 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:44:20.465947 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-f88af10e-88e9-425e-8491-6238407db6db tempest-VolumesSnapshotsTestJSON-1119813040 tempest-VolumesSnapshotsTestJSON-1119813040-project] Returning 404 to user: Volume 9673af10-e3e3-40f6-9585-acc9eb7c3f18 could not be found. {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:44:20.465947 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-f88af10e-88e9-425e-8491-6238407db6db tempest-VolumesSnapshotsTestJSON-1119813040 tempest-VolumesSnapshotsTestJSON-1119813040-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/9673af10-e3e3-40f6-9585-acc9eb7c3f18" status: 404 len: 109 microversion: 2.1 time: 0.041881 Aug 10 11:44:20.465947 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 499/997] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Aug 10 11:44:20 2022] GET /compute/v2.1/os-volumes/9673af10-e3e3-40f6-9585-acc9eb7c3f18 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:44:29.220670 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=7 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:44:29.221447 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=62 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:44:29.226767 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-20f74ffa-beb3-45e6-9282-a7644ffd3540 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-408005339", "imageRef": "99bbc441-5102-4a51-a496-cfbffeb3033a", "flavorRef": "452", "networks": [{"uuid": "c79abae3-7c95-4e3a-aaa6-5f0155e6f94e"}]}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:44:29.279216 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.network.neutron [None req-20f74ffa-beb3-45e6-9282-a7644ffd3540 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] validate_networks() for [('c79abae3-7c95-4e3a-aaa6-5f0155e6f94e', None, None, None, None, None)] {{(pid=124683) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:44:29.671727 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-20f74ffa-beb3-45e6-9282-a7644ffd3540 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Flavor limits 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:44:29.672208 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-20f74ffa-beb3-45e6-9282-a7644ffd3540 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Image limits 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:44:29.672712 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-20f74ffa-beb3-45e6-9282-a7644ffd3540 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Flavor pref 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:44:29.673124 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-20f74ffa-beb3-45e6-9282-a7644ffd3540 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Image pref 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:44:29.673539 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-20f74ffa-beb3-45e6-9282-a7644ffd3540 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:44:29.683052 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-20f74ffa-beb3-45e6-9282-a7644ffd3540 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:29.683534 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-20f74ffa-beb3-45e6-9282-a7644ffd3540 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:29.683996 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-20f74ffa-beb3-45e6-9282-a7644ffd3540 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:29.684730 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-20f74ffa-beb3-45e6-9282-a7644ffd3540 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:29.685187 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-20f74ffa-beb3-45e6-9282-a7644ffd3540 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:29.685615 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-20f74ffa-beb3-45e6-9282-a7644ffd3540 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:29.702984 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-20f74ffa-beb3-45e6-9282-a7644ffd3540 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Getting quotas for project 391d7d61fc51413ea155861701c668c9. Resources: {'ram', 'instances', 'cores'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:44:29.706944 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-20f74ffa-beb3-45e6-9282-a7644ffd3540 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Getting quotas for user 8672cd5c28c14cb68d51a29a009b9371 and project 391d7d61fc51413ea155861701c668c9. Resources: {'ram', 'instances', 'cores'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:44:29.722404 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-20f74ffa-beb3-45e6-9282-a7644ffd3540 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Going to run 1 instances... {{(pid=124683) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:44:29.724736 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-20f74ffa-beb3-45e6-9282-a7644ffd3540 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] [instance: 498e450a-b4d6-4848-af0a-3ce78f0583b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99bbc441-5102-4a51-a496-cfbffeb3033a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124683) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:44:29.857831 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-20f74ffa-beb3-45e6-9282-a7644ffd3540 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.638487 Aug 10 11:44:29.858586 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 499/998] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Aug 10 11:44:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 11:44:29.868146 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:44:29.870216 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=46 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:44:29.874838 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-3026d26b-d0ac-44f4-8854-c5d8090f3092 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:29.877259 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-3026d26b-d0ac-44f4-8854-c5d8090f3092 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] [instance: 498e450a-b4d6-4848-af0a-3ce78f0583b4] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:29.932687 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-3026d26b-d0ac-44f4-8854-c5d8090f3092 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8672cd5c28c14cb68d51a29a009b9371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391d7d61fc51413ea155861701c668c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:44:29.939277 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-3026d26b-d0ac-44f4-8854-c5d8090f3092 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] 10.222.0.62 "GET /compute/v2.1/servers/498e450a-b4d6-4848-af0a-3ce78f0583b4" status: 200 len: 1213 microversion: 2.1 time: 0.072803 Aug 10 11:44:29.939841 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 500/999] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:44:29 2022] GET /compute/v2.1/servers/498e450a-b4d6-4848-af0a-3ce78f0583b4 => generated 1213 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:44:30.961723 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-571296fc-5172-4b5b-8f1b-11b795104b79 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:30.962376 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-571296fc-5172-4b5b-8f1b-11b795104b79 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] [instance: 498e450a-b4d6-4848-af0a-3ce78f0583b4] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:30.969021 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-571296fc-5172-4b5b-8f1b-11b795104b79 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:30.969507 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-571296fc-5172-4b5b-8f1b-11b795104b79 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:30.969993 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-571296fc-5172-4b5b-8f1b-11b795104b79 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:30.970716 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-571296fc-5172-4b5b-8f1b-11b795104b79 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:30.971180 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-571296fc-5172-4b5b-8f1b-11b795104b79 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:30.971618 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-571296fc-5172-4b5b-8f1b-11b795104b79 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:31.033630 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-571296fc-5172-4b5b-8f1b-11b795104b79 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8672cd5c28c14cb68d51a29a009b9371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391d7d61fc51413ea155861701c668c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:44:31.041940 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-571296fc-5172-4b5b-8f1b-11b795104b79 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] 10.222.0.62 "GET /compute/v2.1/servers/498e450a-b4d6-4848-af0a-3ce78f0583b4" status: 200 len: 1217 microversion: 2.1 time: 0.085335 Aug 10 11:44:31.042502 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 500/1000] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:44:30 2022] GET /compute/v2.1/servers/498e450a-b4d6-4848-af0a-3ce78f0583b4 => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:44:32.062806 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-21229d4f-3334-41e4-bbdb-086e41c2811e tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:32.063433 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-21229d4f-3334-41e4-bbdb-086e41c2811e tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] [instance: 498e450a-b4d6-4848-af0a-3ce78f0583b4] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:32.070215 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-21229d4f-3334-41e4-bbdb-086e41c2811e tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:32.070718 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-21229d4f-3334-41e4-bbdb-086e41c2811e tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:32.071162 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-21229d4f-3334-41e4-bbdb-086e41c2811e tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:32.071870 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-21229d4f-3334-41e4-bbdb-086e41c2811e tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:32.072368 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-21229d4f-3334-41e4-bbdb-086e41c2811e tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:32.072801 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-21229d4f-3334-41e4-bbdb-086e41c2811e tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:32.391191 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-21229d4f-3334-41e4-bbdb-086e41c2811e tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8672cd5c28c14cb68d51a29a009b9371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391d7d61fc51413ea155861701c668c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:44:32.399693 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-21229d4f-3334-41e4-bbdb-086e41c2811e tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] 10.222.0.62 "GET /compute/v2.1/servers/498e450a-b4d6-4848-af0a-3ce78f0583b4" status: 200 len: 1273 microversion: 2.1 time: 0.340896 Aug 10 11:44:32.400285 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 501/1001] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:44:32 2022] GET /compute/v2.1/servers/498e450a-b4d6-4848-af0a-3ce78f0583b4 => generated 1273 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:44:33.421437 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-ba44c35f-e11a-4c64-9e3d-e627e63bc861 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:33.422046 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-ba44c35f-e11a-4c64-9e3d-e627e63bc861 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] [instance: 498e450a-b4d6-4848-af0a-3ce78f0583b4] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:33.428703 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ba44c35f-e11a-4c64-9e3d-e627e63bc861 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:33.432727 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ba44c35f-e11a-4c64-9e3d-e627e63bc861 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:33.432727 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ba44c35f-e11a-4c64-9e3d-e627e63bc861 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:33.432727 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ba44c35f-e11a-4c64-9e3d-e627e63bc861 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:33.432727 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ba44c35f-e11a-4c64-9e3d-e627e63bc861 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:33.433114 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ba44c35f-e11a-4c64-9e3d-e627e63bc861 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:33.561781 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-ba44c35f-e11a-4c64-9e3d-e627e63bc861 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8672cd5c28c14cb68d51a29a009b9371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391d7d61fc51413ea155861701c668c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:44:33.570384 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-ba44c35f-e11a-4c64-9e3d-e627e63bc861 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] 10.222.0.62 "GET /compute/v2.1/servers/498e450a-b4d6-4848-af0a-3ce78f0583b4" status: 200 len: 1313 microversion: 2.1 time: 0.152776 Aug 10 11:44:33.570960 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 501/1002] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:44:33 2022] GET /compute/v2.1/servers/498e450a-b4d6-4848-af0a-3ce78f0583b4 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:44:33.867774 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-77ee14e8-b5cf-48da-9c98-fb0dc392e80a req-0a940c7e-a314-4686-9231-74a3a3fb9a7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "498e450a-b4d6-4848-af0a-3ce78f0583b4", "tag": "8d5b419a-c6ce-4e40-94cc-afefe2d94006"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:44:33.876996 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-77ee14e8-b5cf-48da-9c98-fb0dc392e80a req-0a940c7e-a314-4686-9231-74a3a3fb9a7e service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:33.877493 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-77ee14e8-b5cf-48da-9c98-fb0dc392e80a req-0a940c7e-a314-4686-9231-74a3a3fb9a7e service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:33.877920 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-77ee14e8-b5cf-48da-9c98-fb0dc392e80a req-0a940c7e-a314-4686-9231-74a3a3fb9a7e service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:33.889282 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-77ee14e8-b5cf-48da-9c98-fb0dc392e80a req-0a940c7e-a314-4686-9231-74a3a3fb9a7e service nova] Creating event network-changed:8d5b419a-c6ce-4e40-94cc-afefe2d94006 for instance 498e450a-b4d6-4848-af0a-3ce78f0583b4 on hv-cinder-85272 Aug 10 11:44:33.894331 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-77ee14e8-b5cf-48da-9c98-fb0dc392e80a req-0a940c7e-a314-4686-9231-74a3a3fb9a7e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157007 Aug 10 11:44:33.894918 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 502/1003] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:44:34.591387 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-1cc7bdd6-aa1c-474d-8285-ea89c51f4965 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:34.592059 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-1cc7bdd6-aa1c-474d-8285-ea89c51f4965 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] [instance: 498e450a-b4d6-4848-af0a-3ce78f0583b4] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:34.598193 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1cc7bdd6-aa1c-474d-8285-ea89c51f4965 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:34.599223 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1cc7bdd6-aa1c-474d-8285-ea89c51f4965 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:34.599700 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1cc7bdd6-aa1c-474d-8285-ea89c51f4965 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:34.600496 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1cc7bdd6-aa1c-474d-8285-ea89c51f4965 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:34.600957 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1cc7bdd6-aa1c-474d-8285-ea89c51f4965 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:34.601390 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1cc7bdd6-aa1c-474d-8285-ea89c51f4965 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:34.731672 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-1cc7bdd6-aa1c-474d-8285-ea89c51f4965 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8672cd5c28c14cb68d51a29a009b9371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391d7d61fc51413ea155861701c668c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:44:34.739907 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-1cc7bdd6-aa1c-474d-8285-ea89c51f4965 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] 10.222.0.62 "GET /compute/v2.1/servers/498e450a-b4d6-4848-af0a-3ce78f0583b4" status: 200 len: 1313 microversion: 2.1 time: 0.151908 Aug 10 11:44:34.740540 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 502/1004] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:44:34 2022] GET /compute/v2.1/servers/498e450a-b4d6-4848-af0a-3ce78f0583b4 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:44:35.762558 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-ef8d672e-7219-48a9-b4c7-adaa53b0c9a4 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:35.763248 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-ef8d672e-7219-48a9-b4c7-adaa53b0c9a4 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] [instance: 498e450a-b4d6-4848-af0a-3ce78f0583b4] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:35.769577 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ef8d672e-7219-48a9-b4c7-adaa53b0c9a4 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:35.770053 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ef8d672e-7219-48a9-b4c7-adaa53b0c9a4 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:35.771176 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ef8d672e-7219-48a9-b4c7-adaa53b0c9a4 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:35.772144 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ef8d672e-7219-48a9-b4c7-adaa53b0c9a4 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:35.772806 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ef8d672e-7219-48a9-b4c7-adaa53b0c9a4 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:35.773423 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ef8d672e-7219-48a9-b4c7-adaa53b0c9a4 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:35.912651 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-ef8d672e-7219-48a9-b4c7-adaa53b0c9a4 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8672cd5c28c14cb68d51a29a009b9371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391d7d61fc51413ea155861701c668c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:44:35.921075 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-ef8d672e-7219-48a9-b4c7-adaa53b0c9a4 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] 10.222.0.62 "GET /compute/v2.1/servers/498e450a-b4d6-4848-af0a-3ce78f0583b4" status: 200 len: 1313 microversion: 2.1 time: 0.163170 Aug 10 11:44:35.921648 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 503/1005] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:44:35 2022] GET /compute/v2.1/servers/498e450a-b4d6-4848-af0a-3ce78f0583b4 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:44:36.942775 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-1ec7768b-e3af-4d7b-b66d-2e0788b9f2f4 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:36.943556 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-1ec7768b-e3af-4d7b-b66d-2e0788b9f2f4 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] [instance: 498e450a-b4d6-4848-af0a-3ce78f0583b4] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:36.949963 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1ec7768b-e3af-4d7b-b66d-2e0788b9f2f4 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:36.950444 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1ec7768b-e3af-4d7b-b66d-2e0788b9f2f4 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:36.950877 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1ec7768b-e3af-4d7b-b66d-2e0788b9f2f4 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:36.951566 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1ec7768b-e3af-4d7b-b66d-2e0788b9f2f4 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:36.952045 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1ec7768b-e3af-4d7b-b66d-2e0788b9f2f4 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:36.952474 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1ec7768b-e3af-4d7b-b66d-2e0788b9f2f4 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:37.083035 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-1ec7768b-e3af-4d7b-b66d-2e0788b9f2f4 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8672cd5c28c14cb68d51a29a009b9371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391d7d61fc51413ea155861701c668c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:44:37.090490 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-1ec7768b-e3af-4d7b-b66d-2e0788b9f2f4 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] 10.222.0.62 "GET /compute/v2.1/servers/498e450a-b4d6-4848-af0a-3ce78f0583b4" status: 200 len: 1313 microversion: 2.1 time: 0.152232 Aug 10 11:44:37.091089 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 503/1006] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:44:36 2022] GET /compute/v2.1/servers/498e450a-b4d6-4848-af0a-3ce78f0583b4 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:44:38.119189 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-e1ba0ec7-205a-4b28-a778-ad14b654eab1 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:38.119189 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-e1ba0ec7-205a-4b28-a778-ad14b654eab1 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] [instance: 498e450a-b4d6-4848-af0a-3ce78f0583b4] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:38.124792 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e1ba0ec7-205a-4b28-a778-ad14b654eab1 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:38.125388 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e1ba0ec7-205a-4b28-a778-ad14b654eab1 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:38.125813 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e1ba0ec7-205a-4b28-a778-ad14b654eab1 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:38.126502 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e1ba0ec7-205a-4b28-a778-ad14b654eab1 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:38.126954 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e1ba0ec7-205a-4b28-a778-ad14b654eab1 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:38.127379 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e1ba0ec7-205a-4b28-a778-ad14b654eab1 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:38.274919 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-e1ba0ec7-205a-4b28-a778-ad14b654eab1 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8672cd5c28c14cb68d51a29a009b9371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391d7d61fc51413ea155861701c668c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:44:38.282398 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-e1ba0ec7-205a-4b28-a778-ad14b654eab1 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] 10.222.0.62 "GET /compute/v2.1/servers/498e450a-b4d6-4848-af0a-3ce78f0583b4" status: 200 len: 1313 microversion: 2.1 time: 0.169493 Aug 10 11:44:38.282966 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 504/1007] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:44:38 2022] GET /compute/v2.1/servers/498e450a-b4d6-4848-af0a-3ce78f0583b4 => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:44:39.304962 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-fa937744-c406-4b7b-a465-ab4965fee46c tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:39.305574 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-fa937744-c406-4b7b-a465-ab4965fee46c tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] [instance: 498e450a-b4d6-4848-af0a-3ce78f0583b4] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:39.311858 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fa937744-c406-4b7b-a465-ab4965fee46c tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:39.312367 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fa937744-c406-4b7b-a465-ab4965fee46c tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:39.312794 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fa937744-c406-4b7b-a465-ab4965fee46c tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:39.313472 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fa937744-c406-4b7b-a465-ab4965fee46c tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:39.313921 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fa937744-c406-4b7b-a465-ab4965fee46c tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:39.314339 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fa937744-c406-4b7b-a465-ab4965fee46c tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:39.441940 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-fa937744-c406-4b7b-a465-ab4965fee46c tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8672cd5c28c14cb68d51a29a009b9371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391d7d61fc51413ea155861701c668c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:44:39.449882 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-fa937744-c406-4b7b-a465-ab4965fee46c tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] 10.222.0.62 "GET /compute/v2.1/servers/498e450a-b4d6-4848-af0a-3ce78f0583b4" status: 200 len: 1313 microversion: 2.1 time: 0.149556 Aug 10 11:44:39.450448 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 504/1008] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:44:39 2022] GET /compute/v2.1/servers/498e450a-b4d6-4848-af0a-3ce78f0583b4 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:44:40.086599 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-bfd61f30-3876-464a-a921-460bd7c2bd92 req-71e3cc7f-837d-41d1-a014-8959a3349c4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "498e450a-b4d6-4848-af0a-3ce78f0583b4", "name": "network-vif-plugged", "status": "completed", "tag": "8d5b419a-c6ce-4e40-94cc-afefe2d94006"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:44:40.092074 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=2 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:44:40.097172 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-bfd61f30-3876-464a-a921-460bd7c2bd92 req-71e3cc7f-837d-41d1-a014-8959a3349c4d service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:40.097649 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-bfd61f30-3876-464a-a921-460bd7c2bd92 req-71e3cc7f-837d-41d1-a014-8959a3349c4d service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:40.098083 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-bfd61f30-3876-464a-a921-460bd7c2bd92 req-71e3cc7f-837d-41d1-a014-8959a3349c4d service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:40.108763 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-bfd61f30-3876-464a-a921-460bd7c2bd92 req-71e3cc7f-837d-41d1-a014-8959a3349c4d service nova] Creating event network-vif-plugged:8d5b419a-c6ce-4e40-94cc-afefe2d94006 for instance 498e450a-b4d6-4848-af0a-3ce78f0583b4 on hv-cinder-85272 Aug 10 11:44:40.113697 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-bfd61f30-3876-464a-a921-460bd7c2bd92 req-71e3cc7f-837d-41d1-a014-8959a3349c4d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030689 Aug 10 11:44:40.114279 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 505/1009] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:44:40.469305 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-7a6336d1-9812-4096-abfa-5cdc5245f252 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:40.469939 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-7a6336d1-9812-4096-abfa-5cdc5245f252 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] [instance: 498e450a-b4d6-4848-af0a-3ce78f0583b4] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:40.471778 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=2 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:44:40.472663 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=6 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:44:40.479170 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7a6336d1-9812-4096-abfa-5cdc5245f252 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:40.483315 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7a6336d1-9812-4096-abfa-5cdc5245f252 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:40.483315 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7a6336d1-9812-4096-abfa-5cdc5245f252 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:40.483315 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7a6336d1-9812-4096-abfa-5cdc5245f252 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:40.483315 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7a6336d1-9812-4096-abfa-5cdc5245f252 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:40.483772 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7a6336d1-9812-4096-abfa-5cdc5245f252 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:40.614441 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-7a6336d1-9812-4096-abfa-5cdc5245f252 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8672cd5c28c14cb68d51a29a009b9371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391d7d61fc51413ea155861701c668c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:44:40.622964 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-7a6336d1-9812-4096-abfa-5cdc5245f252 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] 10.222.0.62 "GET /compute/v2.1/servers/498e450a-b4d6-4848-af0a-3ce78f0583b4" status: 200 len: 1313 microversion: 2.1 time: 0.157548 Aug 10 11:44:40.623468 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 505/1010] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:44:40 2022] GET /compute/v2.1/servers/498e450a-b4d6-4848-af0a-3ce78f0583b4 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:44:41.645268 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-0b1e3239-908d-4299-a390-642fc9a030ab tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:41.646557 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-0b1e3239-908d-4299-a390-642fc9a030ab tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] [instance: 498e450a-b4d6-4848-af0a-3ce78f0583b4] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:41.653217 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0b1e3239-908d-4299-a390-642fc9a030ab tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:41.653683 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0b1e3239-908d-4299-a390-642fc9a030ab tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:41.654115 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0b1e3239-908d-4299-a390-642fc9a030ab tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:41.654803 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0b1e3239-908d-4299-a390-642fc9a030ab tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:41.655278 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0b1e3239-908d-4299-a390-642fc9a030ab tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:41.655707 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0b1e3239-908d-4299-a390-642fc9a030ab tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:41.791557 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-0b1e3239-908d-4299-a390-642fc9a030ab tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8672cd5c28c14cb68d51a29a009b9371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391d7d61fc51413ea155861701c668c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:44:41.799196 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-0b1e3239-908d-4299-a390-642fc9a030ab tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] 10.222.0.62 "GET /compute/v2.1/servers/498e450a-b4d6-4848-af0a-3ce78f0583b4" status: 200 len: 1313 microversion: 2.1 time: 0.158829 Aug 10 11:44:41.799765 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 506/1011] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:44:41 2022] GET /compute/v2.1/servers/498e450a-b4d6-4848-af0a-3ce78f0583b4 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:44:42.820905 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-77be8eaf-f117-4d54-9d28-e9e97409e479 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:42.821470 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-77be8eaf-f117-4d54-9d28-e9e97409e479 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] [instance: 498e450a-b4d6-4848-af0a-3ce78f0583b4] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:42.827387 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-77be8eaf-f117-4d54-9d28-e9e97409e479 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:42.827867 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-77be8eaf-f117-4d54-9d28-e9e97409e479 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:42.828340 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-77be8eaf-f117-4d54-9d28-e9e97409e479 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:42.829023 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-77be8eaf-f117-4d54-9d28-e9e97409e479 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:42.829472 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-77be8eaf-f117-4d54-9d28-e9e97409e479 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:42.829896 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-77be8eaf-f117-4d54-9d28-e9e97409e479 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:42.956595 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-77be8eaf-f117-4d54-9d28-e9e97409e479 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8672cd5c28c14cb68d51a29a009b9371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391d7d61fc51413ea155861701c668c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:44:42.964191 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-77be8eaf-f117-4d54-9d28-e9e97409e479 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] 10.222.0.62 "GET /compute/v2.1/servers/498e450a-b4d6-4848-af0a-3ce78f0583b4" status: 200 len: 1497 microversion: 2.1 time: 0.148452 Aug 10 11:44:42.964749 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 506/1012] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:44:42 2022] GET /compute/v2.1/servers/498e450a-b4d6-4848-af0a-3ce78f0583b4 => generated 1497 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:44:43.722912 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-08002bf6-5f34-4c26-8e44-a8575a06d743 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:43.723444 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-08002bf6-5f34-4c26-8e44-a8575a06d743 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] [instance: 498e450a-b4d6-4848-af0a-3ce78f0583b4] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:43.729933 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-08002bf6-5f34-4c26-8e44-a8575a06d743 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:43.730414 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-08002bf6-5f34-4c26-8e44-a8575a06d743 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:43.730852 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-08002bf6-5f34-4c26-8e44-a8575a06d743 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:43.731543 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-08002bf6-5f34-4c26-8e44-a8575a06d743 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:43.732023 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-08002bf6-5f34-4c26-8e44-a8575a06d743 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:43.732453 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-08002bf6-5f34-4c26-8e44-a8575a06d743 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:43.757761 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-08002bf6-5f34-4c26-8e44-a8575a06d743 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] [instance: 498e450a-b4d6-4848-af0a-3ce78f0583b4] Going to try to terminate instance {{(pid=124682) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:44:43.981066 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-08002bf6-5f34-4c26-8e44-a8575a06d743 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] 10.222.0.62 "DELETE /compute/v2.1/servers/498e450a-b4d6-4848-af0a-3ce78f0583b4" status: 204 len: 0 microversion: 2.1 time: 0.261731 Aug 10 11:44:43.981729 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 507/1013] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 10 11:44:43 2022] DELETE /compute/v2.1/servers/498e450a-b4d6-4848-af0a-3ce78f0583b4 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:44:43.991080 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-8caeda0d-4a40-4354-8d55-43e927e45fe1 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:43.991544 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-8caeda0d-4a40-4354-8d55-43e927e45fe1 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] [instance: 498e450a-b4d6-4848-af0a-3ce78f0583b4] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:43.999521 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8caeda0d-4a40-4354-8d55-43e927e45fe1 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:44.000032 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8caeda0d-4a40-4354-8d55-43e927e45fe1 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:44.000471 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8caeda0d-4a40-4354-8d55-43e927e45fe1 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:44.001165 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8caeda0d-4a40-4354-8d55-43e927e45fe1 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:44.001617 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8caeda0d-4a40-4354-8d55-43e927e45fe1 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:44.002041 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8caeda0d-4a40-4354-8d55-43e927e45fe1 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:44.138378 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-8caeda0d-4a40-4354-8d55-43e927e45fe1 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8672cd5c28c14cb68d51a29a009b9371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391d7d61fc51413ea155861701c668c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:44:44.146122 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-8caeda0d-4a40-4354-8d55-43e927e45fe1 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] 10.222.0.62 "GET /compute/v2.1/servers/498e450a-b4d6-4848-af0a-3ce78f0583b4" status: 200 len: 1503 microversion: 2.1 time: 0.160261 Aug 10 11:44:44.147825 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 507/1014] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:44:43 2022] GET /compute/v2.1/servers/498e450a-b4d6-4848-af0a-3ce78f0583b4 => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:44:45.168324 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-60e8e207-a958-4ae1-be3c-2321ca78b9c6 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:45.169029 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-60e8e207-a958-4ae1-be3c-2321ca78b9c6 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] [instance: 498e450a-b4d6-4848-af0a-3ce78f0583b4] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:45.175669 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-60e8e207-a958-4ae1-be3c-2321ca78b9c6 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:45.176241 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-60e8e207-a958-4ae1-be3c-2321ca78b9c6 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:45.176697 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-60e8e207-a958-4ae1-be3c-2321ca78b9c6 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:45.177417 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-60e8e207-a958-4ae1-be3c-2321ca78b9c6 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:45.177864 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-60e8e207-a958-4ae1-be3c-2321ca78b9c6 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:45.178281 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-60e8e207-a958-4ae1-be3c-2321ca78b9c6 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:45.310655 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-60e8e207-a958-4ae1-be3c-2321ca78b9c6 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8672cd5c28c14cb68d51a29a009b9371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391d7d61fc51413ea155861701c668c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:44:45.318111 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-60e8e207-a958-4ae1-be3c-2321ca78b9c6 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] 10.222.0.62 "GET /compute/v2.1/servers/498e450a-b4d6-4848-af0a-3ce78f0583b4" status: 200 len: 1503 microversion: 2.1 time: 0.154173 Aug 10 11:44:45.318694 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 508/1015] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:44:45 2022] GET /compute/v2.1/servers/498e450a-b4d6-4848-af0a-3ce78f0583b4 => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:44:45.921671 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-efae7dcc-eeb9-424f-9bf4-694f492d3f79 req-8123a00d-5568-4b19-9920-f7fcbde57f37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "498e450a-b4d6-4848-af0a-3ce78f0583b4", "name": "network-vif-deleted", "tag": "8d5b419a-c6ce-4e40-94cc-afefe2d94006"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:44:45.931729 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-efae7dcc-eeb9-424f-9bf4-694f492d3f79 req-8123a00d-5568-4b19-9920-f7fcbde57f37 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:45.932379 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-efae7dcc-eeb9-424f-9bf4-694f492d3f79 req-8123a00d-5568-4b19-9920-f7fcbde57f37 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:45.932697 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-efae7dcc-eeb9-424f-9bf4-694f492d3f79 req-8123a00d-5568-4b19-9920-f7fcbde57f37 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:45.943535 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-efae7dcc-eeb9-424f-9bf4-694f492d3f79 req-8123a00d-5568-4b19-9920-f7fcbde57f37 service nova] Creating event network-vif-deleted:8d5b419a-c6ce-4e40-94cc-afefe2d94006 for instance 498e450a-b4d6-4848-af0a-3ce78f0583b4 on hv-cinder-85272 Aug 10 11:44:45.948940 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-efae7dcc-eeb9-424f-9bf4-694f492d3f79 req-8123a00d-5568-4b19-9920-f7fcbde57f37 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030829 Aug 10 11:44:45.949567 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 508/1016] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:44:46.340547 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-014219be-44f2-40d8-a785-4a1f39693313 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:46.341195 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-014219be-44f2-40d8-a785-4a1f39693313 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] [instance: 498e450a-b4d6-4848-af0a-3ce78f0583b4] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:46.347638 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-014219be-44f2-40d8-a785-4a1f39693313 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:46.348155 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-014219be-44f2-40d8-a785-4a1f39693313 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:46.348591 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-014219be-44f2-40d8-a785-4a1f39693313 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:46.349269 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-014219be-44f2-40d8-a785-4a1f39693313 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:46.349719 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-014219be-44f2-40d8-a785-4a1f39693313 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:46.350144 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-014219be-44f2-40d8-a785-4a1f39693313 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:46.384019 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-014219be-44f2-40d8-a785-4a1f39693313 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:46.385123 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-014219be-44f2-40d8-a785-4a1f39693313 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:46.385559 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-014219be-44f2-40d8-a785-4a1f39693313 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:46.386000 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.objects.instance [None req-014219be-44f2-40d8-a785-4a1f39693313 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lazy-loading 'fault' on Instance uuid 498e450a-b4d6-4848-af0a-3ce78f0583b4 {{(pid=124682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:44:46.426043 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-014219be-44f2-40d8-a785-4a1f39693313 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8672cd5c28c14cb68d51a29a009b9371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391d7d61fc51413ea155861701c668c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:44:46.433787 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-014219be-44f2-40d8-a785-4a1f39693313 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] 10.222.0.62 "GET /compute/v2.1/servers/498e450a-b4d6-4848-af0a-3ce78f0583b4" status: 200 len: 1303 microversion: 2.1 time: 0.098169 Aug 10 11:44:46.434357 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 509/1017] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:44:46 2022] GET /compute/v2.1/servers/498e450a-b4d6-4848-af0a-3ce78f0583b4 => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:44:47.455782 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-40610332-bcca-4889-882d-24c788502d68 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:47.456430 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-40610332-bcca-4889-882d-24c788502d68 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] [instance: 498e450a-b4d6-4848-af0a-3ce78f0583b4] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:47.462546 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-40610332-bcca-4889-882d-24c788502d68 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:47.463546 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-40610332-bcca-4889-882d-24c788502d68 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:47.463992 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-40610332-bcca-4889-882d-24c788502d68 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:47.464686 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-40610332-bcca-4889-882d-24c788502d68 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:47.465141 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-40610332-bcca-4889-882d-24c788502d68 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:47.465567 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-40610332-bcca-4889-882d-24c788502d68 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:47.479118 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-40610332-bcca-4889-882d-24c788502d68 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] HTTP exception thrown: Instance 498e450a-b4d6-4848-af0a-3ce78f0583b4 could not be found. Aug 10 11:44:47.480759 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-40610332-bcca-4889-882d-24c788502d68 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Request method failure captured: Aug 10 11:44:47.480759 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: request: GET /compute/v2.1/servers/498e450a-b4d6-4848-af0a-3ce78f0583b4 HTTP/1.1 Aug 10 11:44:47.480759 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept: application/json Aug 10 11:44:47.480759 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Aug 10 11:44:47.480759 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Connection: close Aug 10 11:44:47.480759 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Length: 0 Aug 10 11:44:47.480759 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Type: application/json Aug 10 11:44:47.480759 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Host: 10.222.0.62 Aug 10 11:44:47.480759 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Aug 10 11:44:47.480759 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.11 Aug 10 11:44:47.480759 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABi85obXwkb0p0-erEDysWYNG90qyC9qqfOcoNZeNq9jPSeOCnIeHQsyL-Kncty-H6PJfuzHiB-Rk9YLcj28J6q5qbSA49rOt-H9aHhuQ1hAXD9U8yzOY9mIsrTL8-WRbcnLIPsgfKL5KeBvDVeBhRA0JLGNK2Hj4b6IxJyKuehglRx_Ns Aug 10 11:44:47.480759 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Aug 10 11:44:47.480759 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Aug 10 11:44:47.480759 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Aug 10 11:44:47.480759 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Aug 10 11:44:47.480759 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Aug 10 11:44:47.480759 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Aug 10 11:44:47.480759 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Id: 391d7d61fc51413ea155861701c668c9 Aug 10 11:44:47.480759 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-VolumesActionsTest-442106565 Aug 10 11:44:47.480759 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Role: member,reader Aug 10 11:44:47.480759 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Aug 10 11:44:47.482473 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/391d7d61fc51413ea155861701c668c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_391d7d61fc51413ea155861701c668c9", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/391d7d61fc51413ea155861701c668c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/391d7d61fc51413ea155861701c668c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:44:47.482473 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-VolumesActionsTest-442106565 Aug 10 11:44:47.482473 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Id: 391d7d61fc51413ea155861701c668c9 Aug 10 11:44:47.482473 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-VolumesActionsTest-442106565 Aug 10 11:44:47.482473 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User: tempest-VolumesActionsTest-442106565-project Aug 10 11:44:47.482473 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Aug 10 11:44:47.482473 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Aug 10 11:44:47.482473 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Id: 8672cd5c28c14cb68d51a29a009b9371 Aug 10 11:44:47.482473 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-VolumesActionsTest-442106565-project Aug 10 11:44:47.482473 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: method: > Aug 10 11:44:47.482473 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: exception: Instance 498e450a-b4d6-4848-af0a-3ce78f0583b4 could not be found. Aug 10 11:44:47.482473 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: action_args: {'id': '498e450a-b4d6-4848-af0a-3ce78f0583b4'} Aug 10 11:44:47.483521 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:44:47.483521 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:44:47.483521 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:44:47.483521 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:44:47.483521 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:44:47.483521 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:44:47.483521 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:44:47.483521 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:44:47.483521 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:44:47.483521 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:44:47.483521 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 498e450a-b4d6-4848-af0a-3ce78f0583b4 could not be found. Aug 10 11:44:47.483521 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:44:47.483521 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:44:47.483521 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:44:47.483521 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:44:47.483521 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:44:47.483521 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:44:47.483521 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:44:47.483521 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:44:47.483521 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:44:47.484954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:44:47.484954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:44:47.484954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:44:47.484954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:44:47.484954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:44:47.484954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:44:47.484954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:44:47.484954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 498e450a-b4d6-4848-af0a-3ce78f0583b4 could not be found. Aug 10 11:44:47.484954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:44:47.484954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:44:47.484954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:44:47.484954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:44:47.484954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:44:47.484954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:44:47.484954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:44:47.484954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:44:47.484954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 498e450a-b4d6-4848-af0a-3ce78f0583b4 could not be found. Aug 10 11:44:47.484954 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:44:47.486240 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-40610332-bcca-4889-882d-24c788502d68 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Returning 404 to user: Instance 498e450a-b4d6-4848-af0a-3ce78f0583b4 could not be found. {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:44:47.486240 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-40610332-bcca-4889-882d-24c788502d68 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] 10.222.0.62 "GET /compute/v2.1/servers/498e450a-b4d6-4848-af0a-3ce78f0583b4" status: 404 len: 111 microversion: 2.1 time: 0.031215 Aug 10 11:44:47.486240 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 509/1018] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:44:47 2022] GET /compute/v2.1/servers/498e450a-b4d6-4848-af0a-3ce78f0583b4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:44:47.531767 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-3e0a70de-f6ac-4c54-8ebb-9c056b883b5c tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1373246908", "imageRef": "99bbc441-5102-4a51-a496-cfbffeb3033a", "flavorRef": "452", "networks": [{"uuid": "c79abae3-7c95-4e3a-aaa6-5f0155e6f94e"}]}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:44:47.585445 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.network.neutron [None req-3e0a70de-f6ac-4c54-8ebb-9c056b883b5c tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] validate_networks() for [('c79abae3-7c95-4e3a-aaa6-5f0155e6f94e', None, None, None, None, None)] {{(pid=124682) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:44:48.000828 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-3e0a70de-f6ac-4c54-8ebb-9c056b883b5c tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Flavor limits 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:44:48.001401 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-3e0a70de-f6ac-4c54-8ebb-9c056b883b5c tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Image limits 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:44:48.001885 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-3e0a70de-f6ac-4c54-8ebb-9c056b883b5c tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Flavor pref 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:44:48.002320 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-3e0a70de-f6ac-4c54-8ebb-9c056b883b5c tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Image pref 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:44:48.002740 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-3e0a70de-f6ac-4c54-8ebb-9c056b883b5c tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:44:48.012613 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3e0a70de-f6ac-4c54-8ebb-9c056b883b5c tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:48.013142 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3e0a70de-f6ac-4c54-8ebb-9c056b883b5c tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:48.013580 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3e0a70de-f6ac-4c54-8ebb-9c056b883b5c tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:48.014307 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3e0a70de-f6ac-4c54-8ebb-9c056b883b5c tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:48.014766 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3e0a70de-f6ac-4c54-8ebb-9c056b883b5c tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:48.015446 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3e0a70de-f6ac-4c54-8ebb-9c056b883b5c tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:48.034680 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-3e0a70de-f6ac-4c54-8ebb-9c056b883b5c tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Getting quotas for project 391d7d61fc51413ea155861701c668c9. Resources: {'ram', 'instances', 'cores'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:44:48.038994 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-3e0a70de-f6ac-4c54-8ebb-9c056b883b5c tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Getting quotas for user 8672cd5c28c14cb68d51a29a009b9371 and project 391d7d61fc51413ea155861701c668c9. Resources: {'ram', 'instances', 'cores'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:44:48.052310 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-3e0a70de-f6ac-4c54-8ebb-9c056b883b5c tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Going to run 1 instances... {{(pid=124682) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:44:48.054611 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-3e0a70de-f6ac-4c54-8ebb-9c056b883b5c tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] [instance: 1fbc54ec-6d00-4f67-9759-ae014bc3829d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99bbc441-5102-4a51-a496-cfbffeb3033a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:44:48.192270 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-3e0a70de-f6ac-4c54-8ebb-9c056b883b5c tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.664186 Aug 10 11:44:48.193223 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 510/1019] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Aug 10 11:44:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 11:44:48.203759 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-7d48e3e5-0546-4c43-a1b0-119bf408368e tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:48.204400 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-7d48e3e5-0546-4c43-a1b0-119bf408368e tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] [instance: 1fbc54ec-6d00-4f67-9759-ae014bc3829d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:48.261415 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-7d48e3e5-0546-4c43-a1b0-119bf408368e tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8672cd5c28c14cb68d51a29a009b9371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391d7d61fc51413ea155861701c668c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:44:48.269679 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-7d48e3e5-0546-4c43-a1b0-119bf408368e tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] 10.222.0.62 "GET /compute/v2.1/servers/1fbc54ec-6d00-4f67-9759-ae014bc3829d" status: 200 len: 1214 microversion: 2.1 time: 0.069686 Aug 10 11:44:48.277961 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 510/1020] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:44:48 2022] GET /compute/v2.1/servers/1fbc54ec-6d00-4f67-9759-ae014bc3829d => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:44:49.290125 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-f2762ccb-85c6-4118-9991-616639721482 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:49.291388 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-f2762ccb-85c6-4118-9991-616639721482 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] [instance: 1fbc54ec-6d00-4f67-9759-ae014bc3829d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:49.297439 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f2762ccb-85c6-4118-9991-616639721482 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:49.297928 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f2762ccb-85c6-4118-9991-616639721482 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:49.298591 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f2762ccb-85c6-4118-9991-616639721482 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:49.299282 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f2762ccb-85c6-4118-9991-616639721482 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:49.299745 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f2762ccb-85c6-4118-9991-616639721482 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:49.300200 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f2762ccb-85c6-4118-9991-616639721482 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:49.360944 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-f2762ccb-85c6-4118-9991-616639721482 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8672cd5c28c14cb68d51a29a009b9371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391d7d61fc51413ea155861701c668c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:44:49.368577 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-f2762ccb-85c6-4118-9991-616639721482 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] 10.222.0.62 "GET /compute/v2.1/servers/1fbc54ec-6d00-4f67-9759-ae014bc3829d" status: 200 len: 1218 microversion: 2.1 time: 0.082630 Aug 10 11:44:49.369732 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 511/1021] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:44:49 2022] GET /compute/v2.1/servers/1fbc54ec-6d00-4f67-9759-ae014bc3829d => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:44:50.394133 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-2d3f7d16-7bdc-4bc6-a382-f6e5844b0a06 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:50.394762 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-2d3f7d16-7bdc-4bc6-a382-f6e5844b0a06 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] [instance: 1fbc54ec-6d00-4f67-9759-ae014bc3829d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:50.404453 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2d3f7d16-7bdc-4bc6-a382-f6e5844b0a06 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:50.404948 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2d3f7d16-7bdc-4bc6-a382-f6e5844b0a06 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:50.405388 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2d3f7d16-7bdc-4bc6-a382-f6e5844b0a06 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:50.406109 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2d3f7d16-7bdc-4bc6-a382-f6e5844b0a06 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:50.406555 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2d3f7d16-7bdc-4bc6-a382-f6e5844b0a06 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:50.406980 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2d3f7d16-7bdc-4bc6-a382-f6e5844b0a06 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:50.467458 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-2d3f7d16-7bdc-4bc6-a382-f6e5844b0a06 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8672cd5c28c14cb68d51a29a009b9371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391d7d61fc51413ea155861701c668c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:44:50.475119 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-2d3f7d16-7bdc-4bc6-a382-f6e5844b0a06 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] 10.222.0.62 "GET /compute/v2.1/servers/1fbc54ec-6d00-4f67-9759-ae014bc3829d" status: 200 len: 1272 microversion: 2.1 time: 0.086263 Aug 10 11:44:50.476053 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 511/1022] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:44:50 2022] GET /compute/v2.1/servers/1fbc54ec-6d00-4f67-9759-ae014bc3829d => generated 1272 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:44:51.496700 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-87e02b0d-b87a-4762-b05b-96a64ffa6439 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:51.497311 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-87e02b0d-b87a-4762-b05b-96a64ffa6439 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] [instance: 1fbc54ec-6d00-4f67-9759-ae014bc3829d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:51.503827 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-87e02b0d-b87a-4762-b05b-96a64ffa6439 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:51.504372 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-87e02b0d-b87a-4762-b05b-96a64ffa6439 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:51.504810 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-87e02b0d-b87a-4762-b05b-96a64ffa6439 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:51.505534 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-87e02b0d-b87a-4762-b05b-96a64ffa6439 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:51.505991 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-87e02b0d-b87a-4762-b05b-96a64ffa6439 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:51.506423 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-87e02b0d-b87a-4762-b05b-96a64ffa6439 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:51.601402 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-ddbdb258-b039-4c20-b2ec-13c59cc89bbc req-204493a8-5ca7-46df-b66c-0e041dde1115 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fbc54ec-6d00-4f67-9759-ae014bc3829d", "tag": "6b7443f8-8a8e-4adf-8852-025c4686039e"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:44:51.612348 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-ddbdb258-b039-4c20-b2ec-13c59cc89bbc req-204493a8-5ca7-46df-b66c-0e041dde1115 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:51.613070 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-ddbdb258-b039-4c20-b2ec-13c59cc89bbc req-204493a8-5ca7-46df-b66c-0e041dde1115 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:51.613505 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-ddbdb258-b039-4c20-b2ec-13c59cc89bbc req-204493a8-5ca7-46df-b66c-0e041dde1115 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:51.625452 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-ddbdb258-b039-4c20-b2ec-13c59cc89bbc req-204493a8-5ca7-46df-b66c-0e041dde1115 service nova] Creating event network-changed:6b7443f8-8a8e-4adf-8852-025c4686039e for instance 1fbc54ec-6d00-4f67-9759-ae014bc3829d on hv-cinder-85272 Aug 10 11:44:51.630454 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-ddbdb258-b039-4c20-b2ec-13c59cc89bbc req-204493a8-5ca7-46df-b66c-0e041dde1115 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032800 Aug 10 11:44:51.631057 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 512/1023] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:44:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:44:51.727689 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-87e02b0d-b87a-4762-b05b-96a64ffa6439 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8672cd5c28c14cb68d51a29a009b9371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391d7d61fc51413ea155861701c668c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:44:51.740977 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-87e02b0d-b87a-4762-b05b-96a64ffa6439 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] 10.222.0.62 "GET /compute/v2.1/servers/1fbc54ec-6d00-4f67-9759-ae014bc3829d" status: 200 len: 1314 microversion: 2.1 time: 0.248861 Aug 10 11:44:51.741803 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 512/1024] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:44:51 2022] GET /compute/v2.1/servers/1fbc54ec-6d00-4f67-9759-ae014bc3829d => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:44:52.763914 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-db8801bb-c556-471c-8732-7f7a981078b2 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:52.764665 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-db8801bb-c556-471c-8732-7f7a981078b2 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] [instance: 1fbc54ec-6d00-4f67-9759-ae014bc3829d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:52.771473 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-db8801bb-c556-471c-8732-7f7a981078b2 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:52.771953 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-db8801bb-c556-471c-8732-7f7a981078b2 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:52.772417 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-db8801bb-c556-471c-8732-7f7a981078b2 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:52.773104 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-db8801bb-c556-471c-8732-7f7a981078b2 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:52.773579 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-db8801bb-c556-471c-8732-7f7a981078b2 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:52.774006 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-db8801bb-c556-471c-8732-7f7a981078b2 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:52.902659 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-db8801bb-c556-471c-8732-7f7a981078b2 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8672cd5c28c14cb68d51a29a009b9371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391d7d61fc51413ea155861701c668c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:44:52.910056 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-db8801bb-c556-471c-8732-7f7a981078b2 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] 10.222.0.62 "GET /compute/v2.1/servers/1fbc54ec-6d00-4f67-9759-ae014bc3829d" status: 200 len: 1314 microversion: 2.1 time: 0.150992 Aug 10 11:44:52.910616 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 513/1025] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:44:52 2022] GET /compute/v2.1/servers/1fbc54ec-6d00-4f67-9759-ae014bc3829d => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:44:53.930590 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-80a06a9e-31a0-43db-bf4f-933f7d31763e tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:53.931221 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-80a06a9e-31a0-43db-bf4f-933f7d31763e tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] [instance: 1fbc54ec-6d00-4f67-9759-ae014bc3829d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:53.937988 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-80a06a9e-31a0-43db-bf4f-933f7d31763e tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:53.938473 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-80a06a9e-31a0-43db-bf4f-933f7d31763e tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:53.938912 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-80a06a9e-31a0-43db-bf4f-933f7d31763e tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:53.939601 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-80a06a9e-31a0-43db-bf4f-933f7d31763e tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:53.940079 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-80a06a9e-31a0-43db-bf4f-933f7d31763e tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:53.940508 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-80a06a9e-31a0-43db-bf4f-933f7d31763e tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:54.074851 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-80a06a9e-31a0-43db-bf4f-933f7d31763e tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8672cd5c28c14cb68d51a29a009b9371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391d7d61fc51413ea155861701c668c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:44:54.082425 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-80a06a9e-31a0-43db-bf4f-933f7d31763e tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] 10.222.0.62 "GET /compute/v2.1/servers/1fbc54ec-6d00-4f67-9759-ae014bc3829d" status: 200 len: 1314 microversion: 2.1 time: 0.155697 Aug 10 11:44:54.082989 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 513/1026] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:44:53 2022] GET /compute/v2.1/servers/1fbc54ec-6d00-4f67-9759-ae014bc3829d => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:44:55.102062 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-9fbd5132-2b18-4377-a811-e8e2f66b7b5e tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:55.102703 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-9fbd5132-2b18-4377-a811-e8e2f66b7b5e tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] [instance: 1fbc54ec-6d00-4f67-9759-ae014bc3829d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:55.110486 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9fbd5132-2b18-4377-a811-e8e2f66b7b5e tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:55.110968 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9fbd5132-2b18-4377-a811-e8e2f66b7b5e tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:55.111401 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9fbd5132-2b18-4377-a811-e8e2f66b7b5e tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:55.112126 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9fbd5132-2b18-4377-a811-e8e2f66b7b5e tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:55.112575 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9fbd5132-2b18-4377-a811-e8e2f66b7b5e tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:55.113001 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9fbd5132-2b18-4377-a811-e8e2f66b7b5e tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:55.241431 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-9fbd5132-2b18-4377-a811-e8e2f66b7b5e tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8672cd5c28c14cb68d51a29a009b9371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391d7d61fc51413ea155861701c668c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:44:55.249516 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-9fbd5132-2b18-4377-a811-e8e2f66b7b5e tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] 10.222.0.62 "GET /compute/v2.1/servers/1fbc54ec-6d00-4f67-9759-ae014bc3829d" status: 200 len: 1314 microversion: 2.1 time: 0.151320 Aug 10 11:44:55.250089 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 514/1027] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:44:55 2022] GET /compute/v2.1/servers/1fbc54ec-6d00-4f67-9759-ae014bc3829d => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:44:56.269338 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-b03a5fed-cb93-4f41-9f94-8304fe4ecc0e tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:56.269961 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-b03a5fed-cb93-4f41-9f94-8304fe4ecc0e tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] [instance: 1fbc54ec-6d00-4f67-9759-ae014bc3829d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:56.276440 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b03a5fed-cb93-4f41-9f94-8304fe4ecc0e tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:56.276923 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b03a5fed-cb93-4f41-9f94-8304fe4ecc0e tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:56.277359 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b03a5fed-cb93-4f41-9f94-8304fe4ecc0e tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:56.278045 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b03a5fed-cb93-4f41-9f94-8304fe4ecc0e tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:56.278500 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b03a5fed-cb93-4f41-9f94-8304fe4ecc0e tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:56.278928 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b03a5fed-cb93-4f41-9f94-8304fe4ecc0e tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:56.406415 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b03a5fed-cb93-4f41-9f94-8304fe4ecc0e tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8672cd5c28c14cb68d51a29a009b9371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391d7d61fc51413ea155861701c668c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:44:56.413892 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-b03a5fed-cb93-4f41-9f94-8304fe4ecc0e tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] 10.222.0.62 "GET /compute/v2.1/servers/1fbc54ec-6d00-4f67-9759-ae014bc3829d" status: 200 len: 1314 microversion: 2.1 time: 0.148651 Aug 10 11:44:56.414462 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 514/1028] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:44:56 2022] GET /compute/v2.1/servers/1fbc54ec-6d00-4f67-9759-ae014bc3829d => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:44:57.433943 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-602c922f-6af6-4b45-9ecf-aac1098caecf tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:57.434630 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-602c922f-6af6-4b45-9ecf-aac1098caecf tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] [instance: 1fbc54ec-6d00-4f67-9759-ae014bc3829d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:57.441138 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-602c922f-6af6-4b45-9ecf-aac1098caecf tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:57.441621 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-602c922f-6af6-4b45-9ecf-aac1098caecf tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:57.442061 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-602c922f-6af6-4b45-9ecf-aac1098caecf tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:57.442753 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-602c922f-6af6-4b45-9ecf-aac1098caecf tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:57.443208 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-602c922f-6af6-4b45-9ecf-aac1098caecf tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:57.443635 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-602c922f-6af6-4b45-9ecf-aac1098caecf tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:57.574765 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-602c922f-6af6-4b45-9ecf-aac1098caecf tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8672cd5c28c14cb68d51a29a009b9371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391d7d61fc51413ea155861701c668c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:44:57.582487 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-602c922f-6af6-4b45-9ecf-aac1098caecf tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] 10.222.0.62 "GET /compute/v2.1/servers/1fbc54ec-6d00-4f67-9759-ae014bc3829d" status: 200 len: 1314 microversion: 2.1 time: 0.152452 Aug 10 11:44:57.583075 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 515/1029] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:44:57 2022] GET /compute/v2.1/servers/1fbc54ec-6d00-4f67-9759-ae014bc3829d => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:44:58.208972 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-72240248-171a-4d69-82f6-ad817c67a796 req-be468de5-9c7d-4cf6-ab5c-63bdf621366d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fbc54ec-6d00-4f67-9759-ae014bc3829d", "name": "network-vif-plugged", "status": "completed", "tag": "6b7443f8-8a8e-4adf-8852-025c4686039e"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:44:58.215207 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=2 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:44:58.216990 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=6 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:44:58.221044 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-72240248-171a-4d69-82f6-ad817c67a796 req-be468de5-9c7d-4cf6-ab5c-63bdf621366d service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:58.221554 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-72240248-171a-4d69-82f6-ad817c67a796 req-be468de5-9c7d-4cf6-ab5c-63bdf621366d service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:58.221991 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-72240248-171a-4d69-82f6-ad817c67a796 req-be468de5-9c7d-4cf6-ab5c-63bdf621366d service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:58.233306 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-72240248-171a-4d69-82f6-ad817c67a796 req-be468de5-9c7d-4cf6-ab5c-63bdf621366d service nova] Creating event network-vif-plugged:6b7443f8-8a8e-4adf-8852-025c4686039e for instance 1fbc54ec-6d00-4f67-9759-ae014bc3829d on hv-cinder-85272 Aug 10 11:44:58.238257 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-72240248-171a-4d69-82f6-ad817c67a796 req-be468de5-9c7d-4cf6-ab5c-63bdf621366d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032988 Aug 10 11:44:58.239935 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 515/1030] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:44:58.605133 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-168df9f8-8940-46bf-ae83-1e6fd363b19f tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:58.605776 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-168df9f8-8940-46bf-ae83-1e6fd363b19f tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] [instance: 1fbc54ec-6d00-4f67-9759-ae014bc3829d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:58.607739 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=2 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:44:58.612939 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-168df9f8-8940-46bf-ae83-1e6fd363b19f tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:58.613427 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-168df9f8-8940-46bf-ae83-1e6fd363b19f tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:58.613864 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-168df9f8-8940-46bf-ae83-1e6fd363b19f tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:58.614551 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-168df9f8-8940-46bf-ae83-1e6fd363b19f tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:58.615004 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-168df9f8-8940-46bf-ae83-1e6fd363b19f tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:58.615430 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-168df9f8-8940-46bf-ae83-1e6fd363b19f tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:58.746454 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-168df9f8-8940-46bf-ae83-1e6fd363b19f tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8672cd5c28c14cb68d51a29a009b9371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391d7d61fc51413ea155861701c668c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:44:58.753711 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-168df9f8-8940-46bf-ae83-1e6fd363b19f tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] 10.222.0.62 "GET /compute/v2.1/servers/1fbc54ec-6d00-4f67-9759-ae014bc3829d" status: 200 len: 1314 microversion: 2.1 time: 0.152453 Aug 10 11:44:58.754270 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 516/1031] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:44:58 2022] GET /compute/v2.1/servers/1fbc54ec-6d00-4f67-9759-ae014bc3829d => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:44:59.777077 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-61ed97c1-0eb8-49a0-aa47-1267615bd61a tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:59.777684 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-61ed97c1-0eb8-49a0-aa47-1267615bd61a tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] [instance: 1fbc54ec-6d00-4f67-9759-ae014bc3829d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:59.784235 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-61ed97c1-0eb8-49a0-aa47-1267615bd61a tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:59.786796 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-61ed97c1-0eb8-49a0-aa47-1267615bd61a tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:59.786796 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-61ed97c1-0eb8-49a0-aa47-1267615bd61a tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:59.786796 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-61ed97c1-0eb8-49a0-aa47-1267615bd61a tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:59.786796 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-61ed97c1-0eb8-49a0-aa47-1267615bd61a tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:59.787159 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-61ed97c1-0eb8-49a0-aa47-1267615bd61a tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:59.918874 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-61ed97c1-0eb8-49a0-aa47-1267615bd61a tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8672cd5c28c14cb68d51a29a009b9371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391d7d61fc51413ea155861701c668c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:44:59.921197 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:44:59.927033 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-61ed97c1-0eb8-49a0-aa47-1267615bd61a tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] 10.222.0.62 "GET /compute/v2.1/servers/1fbc54ec-6d00-4f67-9759-ae014bc3829d" status: 200 len: 1499 microversion: 2.1 time: 0.155530 Aug 10 11:44:59.927597 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 516/1032] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:44:59 2022] GET /compute/v2.1/servers/1fbc54ec-6d00-4f67-9759-ae014bc3829d => generated 1499 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:45:00.711516 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-c4a4d410-15f5-4220-a210-547ae37e5769 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:45:00.712105 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-c4a4d410-15f5-4220-a210-547ae37e5769 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] [instance: 1fbc54ec-6d00-4f67-9759-ae014bc3829d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:45:00.715116 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:45:00.719737 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c4a4d410-15f5-4220-a210-547ae37e5769 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:45:00.720250 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c4a4d410-15f5-4220-a210-547ae37e5769 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:45:00.720696 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c4a4d410-15f5-4220-a210-547ae37e5769 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:45:00.721419 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c4a4d410-15f5-4220-a210-547ae37e5769 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:45:00.721880 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c4a4d410-15f5-4220-a210-547ae37e5769 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:45:00.722309 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c4a4d410-15f5-4220-a210-547ae37e5769 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:45:00.726182 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=87 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:45:00.749680 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-c4a4d410-15f5-4220-a210-547ae37e5769 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] [instance: 1fbc54ec-6d00-4f67-9759-ae014bc3829d] Going to try to terminate instance {{(pid=124683) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:45:01.047481 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-c4a4d410-15f5-4220-a210-547ae37e5769 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] 10.222.0.62 "DELETE /compute/v2.1/servers/1fbc54ec-6d00-4f67-9759-ae014bc3829d" status: 204 len: 0 microversion: 2.1 time: 0.339154 Aug 10 11:45:01.048654 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 517/1033] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 10 11:45:00 2022] DELETE /compute/v2.1/servers/1fbc54ec-6d00-4f67-9759-ae014bc3829d => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:45:01.057280 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-82975fda-73e7-4688-b87c-d899f77908c4 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:45:01.058005 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-82975fda-73e7-4688-b87c-d899f77908c4 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] [instance: 1fbc54ec-6d00-4f67-9759-ae014bc3829d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:45:01.060331 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:45:01.065332 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-82975fda-73e7-4688-b87c-d899f77908c4 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:45:01.068131 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-82975fda-73e7-4688-b87c-d899f77908c4 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:45:01.068131 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-82975fda-73e7-4688-b87c-d899f77908c4 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:45:01.068131 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-82975fda-73e7-4688-b87c-d899f77908c4 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:45:01.068131 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-82975fda-73e7-4688-b87c-d899f77908c4 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:45:01.068514 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-82975fda-73e7-4688-b87c-d899f77908c4 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:45:01.200311 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-82975fda-73e7-4688-b87c-d899f77908c4 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8672cd5c28c14cb68d51a29a009b9371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391d7d61fc51413ea155861701c668c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:45:01.207897 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-82975fda-73e7-4688-b87c-d899f77908c4 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] 10.222.0.62 "GET /compute/v2.1/servers/1fbc54ec-6d00-4f67-9759-ae014bc3829d" status: 200 len: 1505 microversion: 2.1 time: 0.155099 Aug 10 11:45:01.208471 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 517/1034] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:45:01 2022] GET /compute/v2.1/servers/1fbc54ec-6d00-4f67-9759-ae014bc3829d => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:45:02.230654 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-5236cd0b-99e3-4663-83e0-8a6f96e83d66 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:45:02.231419 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-5236cd0b-99e3-4663-83e0-8a6f96e83d66 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] [instance: 1fbc54ec-6d00-4f67-9759-ae014bc3829d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:45:02.237900 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5236cd0b-99e3-4663-83e0-8a6f96e83d66 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:45:02.238387 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5236cd0b-99e3-4663-83e0-8a6f96e83d66 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:45:02.238822 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5236cd0b-99e3-4663-83e0-8a6f96e83d66 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:45:02.239510 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5236cd0b-99e3-4663-83e0-8a6f96e83d66 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:45:02.239992 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5236cd0b-99e3-4663-83e0-8a6f96e83d66 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:45:02.240419 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5236cd0b-99e3-4663-83e0-8a6f96e83d66 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:45:02.368346 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-5236cd0b-99e3-4663-83e0-8a6f96e83d66 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8672cd5c28c14cb68d51a29a009b9371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391d7d61fc51413ea155861701c668c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:45:02.375845 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-5236cd0b-99e3-4663-83e0-8a6f96e83d66 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] 10.222.0.62 "GET /compute/v2.1/servers/1fbc54ec-6d00-4f67-9759-ae014bc3829d" status: 200 len: 1505 microversion: 2.1 time: 0.149925 Aug 10 11:45:02.376634 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 518/1035] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:45:02 2022] GET /compute/v2.1/servers/1fbc54ec-6d00-4f67-9759-ae014bc3829d => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:45:02.876160 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-c9bbea4a-8817-49bb-baed-13a1818004f5 req-6efc9754-c52f-404d-bcbf-5d4ab791864a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fbc54ec-6d00-4f67-9759-ae014bc3829d", "name": "network-vif-deleted", "tag": "6b7443f8-8a8e-4adf-8852-025c4686039e"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:45:02.887587 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-c9bbea4a-8817-49bb-baed-13a1818004f5 req-6efc9754-c52f-404d-bcbf-5d4ab791864a service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:45:02.888093 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-c9bbea4a-8817-49bb-baed-13a1818004f5 req-6efc9754-c52f-404d-bcbf-5d4ab791864a service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:45:02.888533 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-c9bbea4a-8817-49bb-baed-13a1818004f5 req-6efc9754-c52f-404d-bcbf-5d4ab791864a service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:45:02.899560 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-c9bbea4a-8817-49bb-baed-13a1818004f5 req-6efc9754-c52f-404d-bcbf-5d4ab791864a service nova] Creating event network-vif-deleted:6b7443f8-8a8e-4adf-8852-025c4686039e for instance 1fbc54ec-6d00-4f67-9759-ae014bc3829d on hv-cinder-85272 Aug 10 11:45:02.905353 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-c9bbea4a-8817-49bb-baed-13a1818004f5 req-6efc9754-c52f-404d-bcbf-5d4ab791864a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033624 Aug 10 11:45:02.905932 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 518/1036] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:45:03.396587 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-c322a228-7f48-411e-93c6-48508c06377d tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:45:03.397202 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-c322a228-7f48-411e-93c6-48508c06377d tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] [instance: 1fbc54ec-6d00-4f67-9759-ae014bc3829d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:45:03.404285 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c322a228-7f48-411e-93c6-48508c06377d tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:45:03.404769 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c322a228-7f48-411e-93c6-48508c06377d tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:45:03.405206 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c322a228-7f48-411e-93c6-48508c06377d tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:45:03.405895 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c322a228-7f48-411e-93c6-48508c06377d tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:45:03.406348 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c322a228-7f48-411e-93c6-48508c06377d tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:45:03.406872 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c322a228-7f48-411e-93c6-48508c06377d tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:45:03.436709 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c322a228-7f48-411e-93c6-48508c06377d tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:45:03.437114 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c322a228-7f48-411e-93c6-48508c06377d tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:45:03.437550 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c322a228-7f48-411e-93c6-48508c06377d tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:45:03.437993 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.objects.instance [None req-c322a228-7f48-411e-93c6-48508c06377d tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lazy-loading 'fault' on Instance uuid 1fbc54ec-6d00-4f67-9759-ae014bc3829d {{(pid=124683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:45:03.485268 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-c322a228-7f48-411e-93c6-48508c06377d tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8672cd5c28c14cb68d51a29a009b9371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391d7d61fc51413ea155861701c668c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:45:03.494465 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-c322a228-7f48-411e-93c6-48508c06377d tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] 10.222.0.62 "GET /compute/v2.1/servers/1fbc54ec-6d00-4f67-9759-ae014bc3829d" status: 200 len: 1304 microversion: 2.1 time: 0.100526 Aug 10 11:45:03.495050 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 519/1037] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:45:03 2022] GET /compute/v2.1/servers/1fbc54ec-6d00-4f67-9759-ae014bc3829d => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:45:04.516840 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-67d74ad1-b72c-4cc9-bd69-6de40cd60f61 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:45:04.517461 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-67d74ad1-b72c-4cc9-bd69-6de40cd60f61 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] [instance: 1fbc54ec-6d00-4f67-9759-ae014bc3829d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:45:04.524340 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-67d74ad1-b72c-4cc9-bd69-6de40cd60f61 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:45:04.524820 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-67d74ad1-b72c-4cc9-bd69-6de40cd60f61 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:45:04.525247 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-67d74ad1-b72c-4cc9-bd69-6de40cd60f61 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:45:04.525968 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-67d74ad1-b72c-4cc9-bd69-6de40cd60f61 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:45:04.526603 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-67d74ad1-b72c-4cc9-bd69-6de40cd60f61 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:45:04.527025 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-67d74ad1-b72c-4cc9-bd69-6de40cd60f61 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:45:04.540283 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.wsgi [None req-67d74ad1-b72c-4cc9-bd69-6de40cd60f61 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] HTTP exception thrown: Instance 1fbc54ec-6d00-4f67-9759-ae014bc3829d could not be found. Aug 10 11:45:04.542074 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-67d74ad1-b72c-4cc9-bd69-6de40cd60f61 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Request method failure captured: Aug 10 11:45:04.542074 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: request: GET /compute/v2.1/servers/1fbc54ec-6d00-4f67-9759-ae014bc3829d HTTP/1.1 Aug 10 11:45:04.542074 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Accept: application/json Aug 10 11:45:04.542074 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Aug 10 11:45:04.542074 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Connection: close Aug 10 11:45:04.542074 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Content-Length: 0 Aug 10 11:45:04.542074 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Content-Type: application/json Aug 10 11:45:04.542074 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Host: 10.222.0.62 Aug 10 11:45:04.542074 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Aug 10 11:45:04.542074 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.11 Aug 10 11:45:04.542074 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABi85obXwkb0p0-erEDysWYNG90qyC9qqfOcoNZeNq9jPSeOCnIeHQsyL-Kncty-H6PJfuzHiB-Rk9YLcj28J6q5qbSA49rOt-H9aHhuQ1hAXD9U8yzOY9mIsrTL8-WRbcnLIPsgfKL5KeBvDVeBhRA0JLGNK2Hj4b6IxJyKuehglRx_Ns Aug 10 11:45:04.542074 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Aug 10 11:45:04.542074 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Aug 10 11:45:04.542074 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Aug 10 11:45:04.542074 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Aug 10 11:45:04.542074 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Aug 10 11:45:04.542074 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Aug 10 11:45:04.542074 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Id: 391d7d61fc51413ea155861701c668c9 Aug 10 11:45:04.542074 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-VolumesActionsTest-442106565 Aug 10 11:45:04.542074 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Role: member,reader Aug 10 11:45:04.542074 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Aug 10 11:45:04.543440 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/391d7d61fc51413ea155861701c668c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_391d7d61fc51413ea155861701c668c9", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/391d7d61fc51413ea155861701c668c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/391d7d61fc51413ea155861701c668c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:45:04.543440 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-VolumesActionsTest-442106565 Aug 10 11:45:04.543440 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant-Id: 391d7d61fc51413ea155861701c668c9 Aug 10 11:45:04.543440 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-VolumesActionsTest-442106565 Aug 10 11:45:04.543440 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User: tempest-VolumesActionsTest-442106565-project Aug 10 11:45:04.543440 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Aug 10 11:45:04.543440 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Aug 10 11:45:04.543440 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Id: 8672cd5c28c14cb68d51a29a009b9371 Aug 10 11:45:04.543440 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-VolumesActionsTest-442106565-project Aug 10 11:45:04.543440 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: method: > Aug 10 11:45:04.543440 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: exception: Instance 1fbc54ec-6d00-4f67-9759-ae014bc3829d could not be found. Aug 10 11:45:04.543440 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: action_args: {'id': '1fbc54ec-6d00-4f67-9759-ae014bc3829d'} Aug 10 11:45:04.544274 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:45:04.544274 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:45:04.544274 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:45:04.544274 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:45:04.544274 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:45:04.544274 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:45:04.544274 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:45:04.544274 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:45:04.544274 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:45:04.544274 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:45:04.544274 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fbc54ec-6d00-4f67-9759-ae014bc3829d could not be found. Aug 10 11:45:04.544274 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:45:04.544274 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:45:04.544274 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:45:04.544274 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:45:04.544274 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:45:04.544274 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:45:04.544274 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:45:04.544274 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:45:04.544274 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:45:04.545907 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:45:04.545907 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:45:04.545907 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:45:04.545907 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:45:04.545907 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:45:04.545907 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:45:04.545907 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:45:04.545907 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fbc54ec-6d00-4f67-9759-ae014bc3829d could not be found. Aug 10 11:45:04.545907 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:45:04.545907 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:45:04.545907 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:45:04.545907 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:45:04.545907 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:45:04.545907 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:45:04.545907 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:45:04.545907 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:45:04.545907 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fbc54ec-6d00-4f67-9759-ae014bc3829d could not be found. Aug 10 11:45:04.545907 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:45:04.547287 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-67d74ad1-b72c-4cc9-bd69-6de40cd60f61 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] Returning 404 to user: Instance 1fbc54ec-6d00-4f67-9759-ae014bc3829d could not be found. {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:45:04.547287 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-67d74ad1-b72c-4cc9-bd69-6de40cd60f61 tempest-VolumesActionsTest-442106565 tempest-VolumesActionsTest-442106565-project] 10.222.0.62 "GET /compute/v2.1/servers/1fbc54ec-6d00-4f67-9759-ae014bc3829d" status: 404 len: 111 microversion: 2.1 time: 0.031806 Aug 10 11:45:04.547287 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 519/1038] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:45:04 2022] GET /compute/v2.1/servers/1fbc54ec-6d00-4f67-9759-ae014bc3829d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:45:30.809132 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-7bf89b07-9645-4f22-8636-996cfa7a17e0 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:45:30.809698 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-7bf89b07-9645-4f22-8636-996cfa7a17e0 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:45:30.814557 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=5 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:45:30.815391 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=11 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:45:30.816213 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:45:30.818597 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:45:30.820003 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7bf89b07-9645-4f22-8636-996cfa7a17e0 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:45:30.822942 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7bf89b07-9645-4f22-8636-996cfa7a17e0 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:45:30.822942 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7bf89b07-9645-4f22-8636-996cfa7a17e0 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:45:30.822942 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7bf89b07-9645-4f22-8636-996cfa7a17e0 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:45:30.822942 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7bf89b07-9645-4f22-8636-996cfa7a17e0 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:45:30.823471 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7bf89b07-9645-4f22-8636-996cfa7a17e0 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:45:30.868531 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-7bf89b07-9645-4f22-8636-996cfa7a17e0 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Going to try to terminate instance {{(pid=124683) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:45:30.965295 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-e792b713-a68f-4965-8caa-fef79c2cc6e1 req-ed283cf4-5aab-4d4b-acfd-0d4b5bc2ba18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dd20638-cdb6-4db7-a23e-c98c00e103d9", "tag": "2743679b-eeea-46d5-a860-adc80ef124b6"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:45:30.975573 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-e792b713-a68f-4965-8caa-fef79c2cc6e1 req-ed283cf4-5aab-4d4b-acfd-0d4b5bc2ba18 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:45:30.978308 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-e792b713-a68f-4965-8caa-fef79c2cc6e1 req-ed283cf4-5aab-4d4b-acfd-0d4b5bc2ba18 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:45:30.978308 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-e792b713-a68f-4965-8caa-fef79c2cc6e1 req-ed283cf4-5aab-4d4b-acfd-0d4b5bc2ba18 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:45:30.995627 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-e792b713-a68f-4965-8caa-fef79c2cc6e1 req-ed283cf4-5aab-4d4b-acfd-0d4b5bc2ba18 service nova] Creating event network-changed:2743679b-eeea-46d5-a860-adc80ef124b6 for instance 2dd20638-cdb6-4db7-a23e-c98c00e103d9 on hv-cinder-85272 Aug 10 11:45:31.000810 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-e792b713-a68f-4965-8caa-fef79c2cc6e1 req-ed283cf4-5aab-4d4b-acfd-0d4b5bc2ba18 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193565 Aug 10 11:45:31.001602 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 520/1039] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:45:31.220908 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-7bf89b07-9645-4f22-8636-996cfa7a17e0 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "DELETE /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9" status: 204 len: 0 microversion: 2.1 time: 0.413995 Aug 10 11:45:31.222092 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 520/1040] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 10 11:45:30 2022] DELETE /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:45:31.236067 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-38d21bcb-38c4-43b2-8ef3-cc1fdc2a67e7 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:45:31.237184 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-38d21bcb-38c4-43b2-8ef3-cc1fdc2a67e7 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:45:31.244988 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-38d21bcb-38c4-43b2-8ef3-cc1fdc2a67e7 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:45:31.245784 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-38d21bcb-38c4-43b2-8ef3-cc1fdc2a67e7 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:45:31.246324 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-38d21bcb-38c4-43b2-8ef3-cc1fdc2a67e7 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:45:31.247355 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-38d21bcb-38c4-43b2-8ef3-cc1fdc2a67e7 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:45:31.248059 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-38d21bcb-38c4-43b2-8ef3-cc1fdc2a67e7 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:45:31.248571 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-38d21bcb-38c4-43b2-8ef3-cc1fdc2a67e7 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:45:31.387760 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-38d21bcb-38c4-43b2-8ef3-cc1fdc2a67e7 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c1ca0941b2455995640460a2027f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d656a5891ea40268b8be271b4cc7aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:45:31.395741 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-38d21bcb-38c4-43b2-8ef3-cc1fdc2a67e7 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9" status: 200 len: 1570 microversion: 2.1 time: 0.168640 Aug 10 11:45:31.396545 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 521/1041] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:45:31 2022] GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9 => generated 1570 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:45:32.419216 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-211c8a22-9986-4c80-95e8-d04218b8af27 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:45:32.420448 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-211c8a22-9986-4c80-95e8-d04218b8af27 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:45:32.427927 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-211c8a22-9986-4c80-95e8-d04218b8af27 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:45:32.428454 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-211c8a22-9986-4c80-95e8-d04218b8af27 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:45:32.429114 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-211c8a22-9986-4c80-95e8-d04218b8af27 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:45:32.429826 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-211c8a22-9986-4c80-95e8-d04218b8af27 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:45:32.430284 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-211c8a22-9986-4c80-95e8-d04218b8af27 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:45:32.430721 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-211c8a22-9986-4c80-95e8-d04218b8af27 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:45:32.630157 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-211c8a22-9986-4c80-95e8-d04218b8af27 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c1ca0941b2455995640460a2027f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d656a5891ea40268b8be271b4cc7aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:45:32.638457 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-211c8a22-9986-4c80-95e8-d04218b8af27 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9" status: 200 len: 1570 microversion: 2.1 time: 0.224847 Aug 10 11:45:32.639027 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 521/1042] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:45:32 2022] GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9 => generated 1570 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:45:33.308643 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-c20834d1-8596-4b32-b7c6-bd061be3f1fa req-53495134-e47f-4826-8378-166b5cf909ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dd20638-cdb6-4db7-a23e-c98c00e103d9", "name": "network-vif-deleted", "tag": "2743679b-eeea-46d5-a860-adc80ef124b6"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:45:33.318461 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-c20834d1-8596-4b32-b7c6-bd061be3f1fa req-53495134-e47f-4826-8378-166b5cf909ef service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:45:33.318941 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-c20834d1-8596-4b32-b7c6-bd061be3f1fa req-53495134-e47f-4826-8378-166b5cf909ef service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:45:33.319371 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-c20834d1-8596-4b32-b7c6-bd061be3f1fa req-53495134-e47f-4826-8378-166b5cf909ef service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:45:33.331830 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-c20834d1-8596-4b32-b7c6-bd061be3f1fa req-53495134-e47f-4826-8378-166b5cf909ef service nova] Creating event network-vif-deleted:2743679b-eeea-46d5-a860-adc80ef124b6 for instance 2dd20638-cdb6-4db7-a23e-c98c00e103d9 on hv-cinder-85272 Aug 10 11:45:33.336706 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-c20834d1-8596-4b32-b7c6-bd061be3f1fa req-53495134-e47f-4826-8378-166b5cf909ef service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032591 Aug 10 11:45:33.337281 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 522/1043] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:45:33.665972 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-40191aa3-f7ac-436f-aff0-d85b76eedc91 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:45:33.670299 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-40191aa3-f7ac-436f-aff0-d85b76eedc91 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:45:33.677376 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-40191aa3-f7ac-436f-aff0-d85b76eedc91 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:45:33.677889 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-40191aa3-f7ac-436f-aff0-d85b76eedc91 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:45:33.678319 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-40191aa3-f7ac-436f-aff0-d85b76eedc91 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:45:33.679228 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-40191aa3-f7ac-436f-aff0-d85b76eedc91 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:45:33.679907 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-40191aa3-f7ac-436f-aff0-d85b76eedc91 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:45:33.680362 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-40191aa3-f7ac-436f-aff0-d85b76eedc91 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:45:33.778471 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-40191aa3-f7ac-436f-aff0-d85b76eedc91 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c1ca0941b2455995640460a2027f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d656a5891ea40268b8be271b4cc7aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:45:33.786803 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-40191aa3-f7ac-436f-aff0-d85b76eedc91 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9" status: 200 len: 1219 microversion: 2.1 time: 0.125244 Aug 10 11:45:33.802396 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 522/1044] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:45:33 2022] GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9 => generated 1219 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:45:34.809491 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-416fcaca-7339-406c-a8a6-7ba64b5b3155 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:45:34.810589 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-416fcaca-7339-406c-a8a6-7ba64b5b3155 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] [instance: 2dd20638-cdb6-4db7-a23e-c98c00e103d9] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:45:34.817109 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-416fcaca-7339-406c-a8a6-7ba64b5b3155 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:45:34.817675 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-416fcaca-7339-406c-a8a6-7ba64b5b3155 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:45:34.818179 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-416fcaca-7339-406c-a8a6-7ba64b5b3155 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:45:34.818875 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-416fcaca-7339-406c-a8a6-7ba64b5b3155 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:45:34.819331 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-416fcaca-7339-406c-a8a6-7ba64b5b3155 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:45:34.819764 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-416fcaca-7339-406c-a8a6-7ba64b5b3155 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:45:34.833976 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.wsgi [None req-416fcaca-7339-406c-a8a6-7ba64b5b3155 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] HTTP exception thrown: Instance 2dd20638-cdb6-4db7-a23e-c98c00e103d9 could not be found. Aug 10 11:45:34.835800 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-416fcaca-7339-406c-a8a6-7ba64b5b3155 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Request method failure captured: Aug 10 11:45:34.835800 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: request: GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9 HTTP/1.1 Aug 10 11:45:34.835800 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Accept: application/json Aug 10 11:45:34.835800 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Aug 10 11:45:34.835800 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Connection: close Aug 10 11:45:34.835800 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Content-Length: 0 Aug 10 11:45:34.835800 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Content-Type: application/json Aug 10 11:45:34.835800 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Host: 10.222.0.62 Aug 10 11:45:34.835800 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Aug 10 11:45:34.835800 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.11 Aug 10 11:45:34.835800 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABi85lEhX4Pc5csrUucVobF46Yk_165JBOztZA2yud9fh2v8M3rBHaVoi7kSkIPgyHHfXnho51oiXOs-vXdOqTigSHu5TZjWCLckgXKR1jaY7Ksq1fYQkS6ztWKFiodtovi3bVbX26nv023sCdOUQ9zJVvXEYVnApc5Ju6c2sCrRxj8OY0 Aug 10 11:45:34.835800 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Aug 10 11:45:34.835800 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Aug 10 11:45:34.835800 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Aug 10 11:45:34.835800 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Aug 10 11:45:34.835800 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Aug 10 11:45:34.835800 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Aug 10 11:45:34.835800 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Id: 5d656a5891ea40268b8be271b4cc7aa2 Aug 10 11:45:34.835800 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-TestShelveInstance-861223569 Aug 10 11:45:34.835800 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Role: member,reader Aug 10 11:45:34.835800 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Aug 10 11:45:34.837590 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/5d656a5891ea40268b8be271b4cc7aa2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_5d656a5891ea40268b8be271b4cc7aa2", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5d656a5891ea40268b8be271b4cc7aa2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5d656a5891ea40268b8be271b4cc7aa2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:45:34.837590 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-TestShelveInstance-861223569 Aug 10 11:45:34.837590 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant-Id: 5d656a5891ea40268b8be271b4cc7aa2 Aug 10 11:45:34.837590 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-TestShelveInstance-861223569 Aug 10 11:45:34.837590 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User: tempest-TestShelveInstance-861223569-project Aug 10 11:45:34.837590 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Aug 10 11:45:34.837590 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Aug 10 11:45:34.837590 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Id: b6c1ca0941b2455995640460a2027f19 Aug 10 11:45:34.837590 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-TestShelveInstance-861223569-project Aug 10 11:45:34.837590 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: method: > Aug 10 11:45:34.837590 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: exception: Instance 2dd20638-cdb6-4db7-a23e-c98c00e103d9 could not be found. Aug 10 11:45:34.837590 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: action_args: {'id': '2dd20638-cdb6-4db7-a23e-c98c00e103d9'} Aug 10 11:45:34.839343 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:45:34.839343 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:45:34.839343 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:45:34.839343 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:45:34.839343 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:45:34.839343 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:45:34.839343 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:45:34.839343 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:45:34.839343 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:45:34.839343 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:45:34.839343 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dd20638-cdb6-4db7-a23e-c98c00e103d9 could not be found. Aug 10 11:45:34.839343 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:45:34.839343 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:45:34.839343 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:45:34.839343 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:45:34.839343 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:45:34.839343 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:45:34.839343 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:45:34.839343 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:45:34.839343 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:45:34.841135 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:45:34.841135 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:45:34.841135 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:45:34.841135 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:45:34.841135 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:45:34.841135 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:45:34.841135 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:45:34.841135 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dd20638-cdb6-4db7-a23e-c98c00e103d9 could not be found. Aug 10 11:45:34.841135 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:45:34.841135 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:45:34.841135 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:45:34.841135 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:45:34.841135 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:45:34.841135 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:45:34.841135 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:45:34.841135 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:45:34.841135 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dd20638-cdb6-4db7-a23e-c98c00e103d9 could not be found. Aug 10 11:45:34.841135 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Aug 10 11:45:34.842814 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-416fcaca-7339-406c-a8a6-7ba64b5b3155 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Returning 404 to user: Instance 2dd20638-cdb6-4db7-a23e-c98c00e103d9 could not be found. {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:45:34.842814 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-416fcaca-7339-406c-a8a6-7ba64b5b3155 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9" status: 404 len: 111 microversion: 2.1 time: 0.032031 Aug 10 11:45:34.842814 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 523/1045] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:45:34 2022] GET /compute/v2.1/servers/2dd20638-cdb6-4db7-a23e-c98c00e103d9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 11:45:35.109055 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-27bbcccf-8c36-414d-862f-a4f90e0d09a3 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] Calling method '.version_select at 0x7fb7cdb4f940>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:45:35.198147 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-27bbcccf-8c36-414d-862f-a4f90e0d09a3 tempest-TestShelveInstance-861223569 tempest-TestShelveInstance-861223569-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1775361532" status: 202 len: 0 microversion: 2.1 time: 0.092191 Aug 10 11:45:35.203007 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 523/1046] 10.222.0.62 () {58 vars in 1254 bytes} [Wed Aug 10 11:45:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1775361532 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 11:45:56.538012 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-2dc38f83-4229-40de-9173-b986301968a6 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Action: 'create', calling method: .version_select at 0x7fb7ce566280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1010971622", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0Xdc5Fo5oQ1R3u0nhasgCi6KdY+Q1BVl2+HwZoBlGKQBj8IP+6e3ZESeiIBimT/72Ujn8ZQZuzqo2czEURGntysPyT6oVSyLhcE8MfKh7kotj5U3AtTT8OswwbeczNAw=="}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:45:56.544745 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=8 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:45:56.545389 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=12 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:45:56.555847 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-2dc38f83-4229-40de-9173-b986301968a6 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Getting quotas for project 1842fcd00b26484581ba3e681fdc6ecd. Resources: {'key_pairs'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:45:56.561079 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-2dc38f83-4229-40de-9173-b986301968a6 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Getting quotas for user 4cfca5c513604cfba864b27067799407 and project 1842fcd00b26484581ba3e681fdc6ecd. Resources: {'key_pairs'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:45:56.647568 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-2dc38f83-4229-40de-9173-b986301968a6 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.113311 Aug 10 11:45:56.648365 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 524/1047] 10.222.0.62 () {60 vars in 1159 bytes} [Wed Aug 10 11:45:56 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:45:56.741805 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:45:56.742656 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:45:56.746716 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-912cb3ac-bdb2-447b-9bdf-7d73db36cc95 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-998971170", "imageRef": "faa66376-12d3-44fb-8c1c-69e9c8506570", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1010971622", "networks": [{"uuid": "a19fe903-b8ec-4798-a1b4-d9fe988cc58f"}]}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:45:56.801548 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.network.neutron [None req-912cb3ac-bdb2-447b-9bdf-7d73db36cc95 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] validate_networks() for [('a19fe903-b8ec-4798-a1b4-d9fe988cc58f', None, None, None, None, None)] {{(pid=124683) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:45:57.163050 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-912cb3ac-bdb2-447b-9bdf-7d73db36cc95 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Flavor limits 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:45:57.163493 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-912cb3ac-bdb2-447b-9bdf-7d73db36cc95 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Image limits 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:45:57.163977 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-912cb3ac-bdb2-447b-9bdf-7d73db36cc95 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Flavor pref 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:45:57.164406 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-912cb3ac-bdb2-447b-9bdf-7d73db36cc95 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Image pref 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:45:57.164825 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-912cb3ac-bdb2-447b-9bdf-7d73db36cc95 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:45:57.174451 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-912cb3ac-bdb2-447b-9bdf-7d73db36cc95 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:45:57.174938 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-912cb3ac-bdb2-447b-9bdf-7d73db36cc95 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:45:57.175380 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-912cb3ac-bdb2-447b-9bdf-7d73db36cc95 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:45:57.176158 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-912cb3ac-bdb2-447b-9bdf-7d73db36cc95 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:45:57.176620 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-912cb3ac-bdb2-447b-9bdf-7d73db36cc95 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:45:57.177050 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-912cb3ac-bdb2-447b-9bdf-7d73db36cc95 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:45:57.193537 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-912cb3ac-bdb2-447b-9bdf-7d73db36cc95 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Getting quotas for project 1842fcd00b26484581ba3e681fdc6ecd. Resources: {'ram', 'instances', 'cores'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:45:57.197467 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-912cb3ac-bdb2-447b-9bdf-7d73db36cc95 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Getting quotas for user 4cfca5c513604cfba864b27067799407 and project 1842fcd00b26484581ba3e681fdc6ecd. Resources: {'ram', 'instances', 'cores'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:45:57.208384 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-912cb3ac-bdb2-447b-9bdf-7d73db36cc95 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Going to run 1 instances... {{(pid=124683) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:45:57.210610 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-912cb3ac-bdb2-447b-9bdf-7d73db36cc95 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] [instance: 26420667-2913-420e-a978-d82b57dbb0fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='faa66376-12d3-44fb-8c1c-69e9c8506570',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124683) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:45:57.335438 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-912cb3ac-bdb2-447b-9bdf-7d73db36cc95 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.595117 Aug 10 11:45:57.336107 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 524/1048] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Aug 10 11:45:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 11:45:57.347714 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-aaf54b39-0590-4d2b-879e-890df73714fa tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:45:57.348427 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-aaf54b39-0590-4d2b-879e-890df73714fa tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] [instance: 26420667-2913-420e-a978-d82b57dbb0fc] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:45:57.412084 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-aaf54b39-0590-4d2b-879e-890df73714fa tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfca5c513604cfba864b27067799407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1842fcd00b26484581ba3e681fdc6ecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:45:57.421687 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-aaf54b39-0590-4d2b-879e-890df73714fa tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] 10.222.0.62 "GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc" status: 200 len: 1258 microversion: 2.1 time: 0.078254 Aug 10 11:45:57.422238 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 525/1049] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:45:57 2022] GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc => generated 1258 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:45:58.442899 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-a9ce0905-4c81-49a8-8011-cb1123ddd471 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:45:58.443428 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-a9ce0905-4c81-49a8-8011-cb1123ddd471 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] [instance: 26420667-2913-420e-a978-d82b57dbb0fc] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:45:58.495892 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-a9ce0905-4c81-49a8-8011-cb1123ddd471 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfca5c513604cfba864b27067799407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1842fcd00b26484581ba3e681fdc6ecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:45:58.503642 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-a9ce0905-4c81-49a8-8011-cb1123ddd471 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] 10.222.0.62 "GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc" status: 200 len: 1258 microversion: 2.1 time: 0.065168 Aug 10 11:45:58.504233 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 525/1050] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:45:58 2022] GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc => generated 1258 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:45:59.524406 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-e320b663-ec9c-4906-aa5e-4641a392e0c9 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:45:59.525640 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-e320b663-ec9c-4906-aa5e-4641a392e0c9 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] [instance: 26420667-2913-420e-a978-d82b57dbb0fc] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:45:59.531646 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e320b663-ec9c-4906-aa5e-4641a392e0c9 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:45:59.532174 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e320b663-ec9c-4906-aa5e-4641a392e0c9 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:45:59.532612 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e320b663-ec9c-4906-aa5e-4641a392e0c9 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:45:59.533309 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e320b663-ec9c-4906-aa5e-4641a392e0c9 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:45:59.533766 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e320b663-ec9c-4906-aa5e-4641a392e0c9 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:45:59.534197 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e320b663-ec9c-4906-aa5e-4641a392e0c9 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:45:59.631786 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-e320b663-ec9c-4906-aa5e-4641a392e0c9 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfca5c513604cfba864b27067799407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1842fcd00b26484581ba3e681fdc6ecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:45:59.639856 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-e320b663-ec9c-4906-aa5e-4641a392e0c9 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] 10.222.0.62 "GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc" status: 200 len: 1318 microversion: 2.1 time: 0.119341 Aug 10 11:45:59.640747 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 526/1051] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:45:59 2022] GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc => generated 1318 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:46:00.662695 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-5b51e8f8-86f5-4c63-8bfa-4713efa50c31 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:46:00.663277 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-5b51e8f8-86f5-4c63-8bfa-4713efa50c31 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] [instance: 26420667-2913-420e-a978-d82b57dbb0fc] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:46:00.670562 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5b51e8f8-86f5-4c63-8bfa-4713efa50c31 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:00.671497 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5b51e8f8-86f5-4c63-8bfa-4713efa50c31 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:00.672206 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5b51e8f8-86f5-4c63-8bfa-4713efa50c31 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:00.673224 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5b51e8f8-86f5-4c63-8bfa-4713efa50c31 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:00.673925 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5b51e8f8-86f5-4c63-8bfa-4713efa50c31 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:00.674578 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5b51e8f8-86f5-4c63-8bfa-4713efa50c31 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:00.812706 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-5b51e8f8-86f5-4c63-8bfa-4713efa50c31 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfca5c513604cfba864b27067799407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1842fcd00b26484581ba3e681fdc6ecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:46:00.820268 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-5b51e8f8-86f5-4c63-8bfa-4713efa50c31 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] 10.222.0.62 "GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc" status: 200 len: 1358 microversion: 2.1 time: 0.162158 Aug 10 11:46:00.820846 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 526/1052] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:46:00 2022] GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:46:01.840864 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-db373376-82bc-4646-b2cd-abd0fb05c82a tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:46:01.841484 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-db373376-82bc-4646-b2cd-abd0fb05c82a tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] [instance: 26420667-2913-420e-a978-d82b57dbb0fc] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:46:01.848155 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-db373376-82bc-4646-b2cd-abd0fb05c82a tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:01.848653 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-db373376-82bc-4646-b2cd-abd0fb05c82a tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:01.849116 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-db373376-82bc-4646-b2cd-abd0fb05c82a tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:01.849817 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-db373376-82bc-4646-b2cd-abd0fb05c82a tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:01.850276 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-db373376-82bc-4646-b2cd-abd0fb05c82a tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:01.850702 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-db373376-82bc-4646-b2cd-abd0fb05c82a tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:01.989828 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-db373376-82bc-4646-b2cd-abd0fb05c82a tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfca5c513604cfba864b27067799407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1842fcd00b26484581ba3e681fdc6ecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:46:01.998882 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-db373376-82bc-4646-b2cd-abd0fb05c82a tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] 10.222.0.62 "GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc" status: 200 len: 1358 microversion: 2.1 time: 0.161597 Aug 10 11:46:01.999939 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 527/1053] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:46:01 2022] GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:46:03.020906 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-45fccf7a-1a91-4d70-bf82-e1f2ddabebaf tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:46:03.021454 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-45fccf7a-1a91-4d70-bf82-e1f2ddabebaf tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] [instance: 26420667-2913-420e-a978-d82b57dbb0fc] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:46:03.028522 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-45fccf7a-1a91-4d70-bf82-e1f2ddabebaf tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:03.029013 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-45fccf7a-1a91-4d70-bf82-e1f2ddabebaf tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:03.029440 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-45fccf7a-1a91-4d70-bf82-e1f2ddabebaf tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:03.030143 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-45fccf7a-1a91-4d70-bf82-e1f2ddabebaf tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:03.030599 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-45fccf7a-1a91-4d70-bf82-e1f2ddabebaf tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:03.031032 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-45fccf7a-1a91-4d70-bf82-e1f2ddabebaf tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:03.162790 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-45fccf7a-1a91-4d70-bf82-e1f2ddabebaf tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfca5c513604cfba864b27067799407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1842fcd00b26484581ba3e681fdc6ecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:46:03.176881 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-45fccf7a-1a91-4d70-bf82-e1f2ddabebaf tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] 10.222.0.62 "GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc" status: 200 len: 1358 microversion: 2.1 time: 0.159822 Aug 10 11:46:03.177472 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 527/1054] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:46:03 2022] GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:46:04.201070 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-4965d341-2359-4016-867b-1f2ab1cc0def tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:46:04.201746 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-4965d341-2359-4016-867b-1f2ab1cc0def tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] [instance: 26420667-2913-420e-a978-d82b57dbb0fc] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:46:04.208751 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4965d341-2359-4016-867b-1f2ab1cc0def tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:04.209242 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4965d341-2359-4016-867b-1f2ab1cc0def tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:04.209680 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4965d341-2359-4016-867b-1f2ab1cc0def tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:04.210384 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4965d341-2359-4016-867b-1f2ab1cc0def tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:04.210835 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4965d341-2359-4016-867b-1f2ab1cc0def tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:04.211256 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4965d341-2359-4016-867b-1f2ab1cc0def tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:04.353323 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-4965d341-2359-4016-867b-1f2ab1cc0def tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfca5c513604cfba864b27067799407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1842fcd00b26484581ba3e681fdc6ecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:46:04.361877 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-4965d341-2359-4016-867b-1f2ab1cc0def tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] 10.222.0.62 "GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc" status: 200 len: 1358 microversion: 2.1 time: 0.167198 Aug 10 11:46:04.365886 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 528/1055] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:46:04 2022] GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:46:05.382802 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-7e03ae0d-410a-4cb0-86b7-8761cea3d5dd tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:46:05.383434 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-7e03ae0d-410a-4cb0-86b7-8761cea3d5dd tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] [instance: 26420667-2913-420e-a978-d82b57dbb0fc] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:46:05.391484 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7e03ae0d-410a-4cb0-86b7-8761cea3d5dd tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:05.391991 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7e03ae0d-410a-4cb0-86b7-8761cea3d5dd tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:05.392495 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7e03ae0d-410a-4cb0-86b7-8761cea3d5dd tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:05.393261 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7e03ae0d-410a-4cb0-86b7-8761cea3d5dd tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:05.393675 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7e03ae0d-410a-4cb0-86b7-8761cea3d5dd tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:05.394102 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7e03ae0d-410a-4cb0-86b7-8761cea3d5dd tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:05.537862 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-7e03ae0d-410a-4cb0-86b7-8761cea3d5dd tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfca5c513604cfba864b27067799407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1842fcd00b26484581ba3e681fdc6ecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:46:05.546761 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-7e03ae0d-410a-4cb0-86b7-8761cea3d5dd tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] 10.222.0.62 "GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc" status: 200 len: 1358 microversion: 2.1 time: 0.167826 Aug 10 11:46:05.547540 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 528/1056] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:46:05 2022] GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:46:06.566789 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-a2978e4d-6959-449b-ae84-f3040d1a1a01 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:46:06.567422 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-a2978e4d-6959-449b-ae84-f3040d1a1a01 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] [instance: 26420667-2913-420e-a978-d82b57dbb0fc] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:46:06.574765 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a2978e4d-6959-449b-ae84-f3040d1a1a01 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:06.575260 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a2978e4d-6959-449b-ae84-f3040d1a1a01 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:06.575852 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a2978e4d-6959-449b-ae84-f3040d1a1a01 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:06.576592 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a2978e4d-6959-449b-ae84-f3040d1a1a01 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:06.577050 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a2978e4d-6959-449b-ae84-f3040d1a1a01 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:06.577483 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a2978e4d-6959-449b-ae84-f3040d1a1a01 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:06.718911 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-a2978e4d-6959-449b-ae84-f3040d1a1a01 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfca5c513604cfba864b27067799407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1842fcd00b26484581ba3e681fdc6ecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:46:06.726694 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-a2978e4d-6959-449b-ae84-f3040d1a1a01 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] 10.222.0.62 "GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc" status: 200 len: 1358 microversion: 2.1 time: 0.163780 Aug 10 11:46:06.727272 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 529/1057] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:46:06 2022] GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:46:07.747540 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-9a324095-4a0f-4ca3-87bb-fa9c74281e42 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:46:07.748260 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-9a324095-4a0f-4ca3-87bb-fa9c74281e42 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] [instance: 26420667-2913-420e-a978-d82b57dbb0fc] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:46:07.750615 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=2 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:46:07.757251 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9a324095-4a0f-4ca3-87bb-fa9c74281e42 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:07.757751 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9a324095-4a0f-4ca3-87bb-fa9c74281e42 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:07.758193 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9a324095-4a0f-4ca3-87bb-fa9c74281e42 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:07.760414 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9a324095-4a0f-4ca3-87bb-fa9c74281e42 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:07.761015 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9a324095-4a0f-4ca3-87bb-fa9c74281e42 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:07.762193 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9a324095-4a0f-4ca3-87bb-fa9c74281e42 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:07.905955 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-9a324095-4a0f-4ca3-87bb-fa9c74281e42 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfca5c513604cfba864b27067799407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1842fcd00b26484581ba3e681fdc6ecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:46:07.914118 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-9a324095-4a0f-4ca3-87bb-fa9c74281e42 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] 10.222.0.62 "GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc" status: 200 len: 1358 microversion: 2.1 time: 0.171170 Aug 10 11:46:07.924108 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 529/1058] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:46:07 2022] GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:46:08.936497 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-b31aafee-88e4-4d99-99b4-89d6e4be7131 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:46:08.937125 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-b31aafee-88e4-4d99-99b4-89d6e4be7131 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] [instance: 26420667-2913-420e-a978-d82b57dbb0fc] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:46:08.938958 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=6 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:46:08.944152 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b31aafee-88e4-4d99-99b4-89d6e4be7131 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:08.944643 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b31aafee-88e4-4d99-99b4-89d6e4be7131 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:08.945082 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b31aafee-88e4-4d99-99b4-89d6e4be7131 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:08.945778 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b31aafee-88e4-4d99-99b4-89d6e4be7131 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:08.946318 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b31aafee-88e4-4d99-99b4-89d6e4be7131 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:08.946745 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b31aafee-88e4-4d99-99b4-89d6e4be7131 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:09.076533 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b31aafee-88e4-4d99-99b4-89d6e4be7131 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfca5c513604cfba864b27067799407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1842fcd00b26484581ba3e681fdc6ecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:46:09.084956 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-b31aafee-88e4-4d99-99b4-89d6e4be7131 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] 10.222.0.62 "GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc" status: 200 len: 1358 microversion: 2.1 time: 0.152289 Aug 10 11:46:09.087919 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 530/1059] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:46:08 2022] GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:46:09.793257 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-ecdb08a0-1bf2-487c-b92b-65c07dd5b157 req-f0f13566-b46a-4957-8e36-cc7189f87525 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26420667-2913-420e-a978-d82b57dbb0fc", "tag": "664bc1b1-0740-4b33-a697-a2970a2f2249"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:46:09.798273 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=8 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:46:09.804359 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-ecdb08a0-1bf2-487c-b92b-65c07dd5b157 req-f0f13566-b46a-4957-8e36-cc7189f87525 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:09.804838 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-ecdb08a0-1bf2-487c-b92b-65c07dd5b157 req-f0f13566-b46a-4957-8e36-cc7189f87525 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:09.805279 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-ecdb08a0-1bf2-487c-b92b-65c07dd5b157 req-f0f13566-b46a-4957-8e36-cc7189f87525 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:09.816469 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-ecdb08a0-1bf2-487c-b92b-65c07dd5b157 req-f0f13566-b46a-4957-8e36-cc7189f87525 service nova] Creating event network-changed:664bc1b1-0740-4b33-a697-a2970a2f2249 for instance 26420667-2913-420e-a978-d82b57dbb0fc on hv-cinder-85272 Aug 10 11:46:09.822014 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-ecdb08a0-1bf2-487c-b92b-65c07dd5b157 req-f0f13566-b46a-4957-8e36-cc7189f87525 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033987 Aug 10 11:46:09.822900 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 530/1060] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:46:10.106545 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-6072e0ea-5016-4c1f-962d-0e06df8540ef tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:46:10.107280 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-6072e0ea-5016-4c1f-962d-0e06df8540ef tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] [instance: 26420667-2913-420e-a978-d82b57dbb0fc] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:46:10.113872 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6072e0ea-5016-4c1f-962d-0e06df8540ef tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:10.114433 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6072e0ea-5016-4c1f-962d-0e06df8540ef tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:10.114943 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6072e0ea-5016-4c1f-962d-0e06df8540ef tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:10.115711 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6072e0ea-5016-4c1f-962d-0e06df8540ef tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:10.116266 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6072e0ea-5016-4c1f-962d-0e06df8540ef tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:10.116770 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6072e0ea-5016-4c1f-962d-0e06df8540ef tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:10.318333 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-6072e0ea-5016-4c1f-962d-0e06df8540ef tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfca5c513604cfba864b27067799407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1842fcd00b26484581ba3e681fdc6ecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:46:10.325939 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-6072e0ea-5016-4c1f-962d-0e06df8540ef tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] 10.222.0.62 "GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc" status: 200 len: 1358 microversion: 2.1 time: 0.223708 Aug 10 11:46:10.326509 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 531/1061] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:46:10 2022] GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc => generated 1358 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:46:11.346447 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-6aa07b45-f984-4d19-868a-c348fbd326e7 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:46:11.347151 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-6aa07b45-f984-4d19-868a-c348fbd326e7 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] [instance: 26420667-2913-420e-a978-d82b57dbb0fc] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:46:11.354606 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6aa07b45-f984-4d19-868a-c348fbd326e7 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:11.355086 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6aa07b45-f984-4d19-868a-c348fbd326e7 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:11.355525 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6aa07b45-f984-4d19-868a-c348fbd326e7 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:11.356255 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6aa07b45-f984-4d19-868a-c348fbd326e7 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:11.356715 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6aa07b45-f984-4d19-868a-c348fbd326e7 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:11.357144 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6aa07b45-f984-4d19-868a-c348fbd326e7 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:11.492606 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-6aa07b45-f984-4d19-868a-c348fbd326e7 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfca5c513604cfba864b27067799407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1842fcd00b26484581ba3e681fdc6ecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:46:11.500126 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-6aa07b45-f984-4d19-868a-c348fbd326e7 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] 10.222.0.62 "GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc" status: 200 len: 1358 microversion: 2.1 time: 0.158486 Aug 10 11:46:11.500705 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 531/1062] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:46:11 2022] GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:46:12.520924 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-0dea7c42-e0b2-4e49-94c7-2a0bd9a70853 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:46:12.521546 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-0dea7c42-e0b2-4e49-94c7-2a0bd9a70853 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] [instance: 26420667-2913-420e-a978-d82b57dbb0fc] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:46:12.528584 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0dea7c42-e0b2-4e49-94c7-2a0bd9a70853 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:12.529062 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0dea7c42-e0b2-4e49-94c7-2a0bd9a70853 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:12.529496 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0dea7c42-e0b2-4e49-94c7-2a0bd9a70853 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:12.530180 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0dea7c42-e0b2-4e49-94c7-2a0bd9a70853 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:12.531007 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0dea7c42-e0b2-4e49-94c7-2a0bd9a70853 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:12.531135 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0dea7c42-e0b2-4e49-94c7-2a0bd9a70853 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:12.661383 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-0dea7c42-e0b2-4e49-94c7-2a0bd9a70853 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfca5c513604cfba864b27067799407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1842fcd00b26484581ba3e681fdc6ecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:46:12.669576 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-0dea7c42-e0b2-4e49-94c7-2a0bd9a70853 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] 10.222.0.62 "GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc" status: 200 len: 1358 microversion: 2.1 time: 0.152518 Aug 10 11:46:12.672936 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 532/1063] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:46:12 2022] GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:46:13.691327 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-b4b9e240-d77d-42ed-ac1c-f08d0f3a072d tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:46:13.691925 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-b4b9e240-d77d-42ed-ac1c-f08d0f3a072d tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] [instance: 26420667-2913-420e-a978-d82b57dbb0fc] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:46:13.698222 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b4b9e240-d77d-42ed-ac1c-f08d0f3a072d tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:13.698695 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b4b9e240-d77d-42ed-ac1c-f08d0f3a072d tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:13.699123 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b4b9e240-d77d-42ed-ac1c-f08d0f3a072d tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:13.699797 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b4b9e240-d77d-42ed-ac1c-f08d0f3a072d tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:13.700274 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b4b9e240-d77d-42ed-ac1c-f08d0f3a072d tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:13.700692 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b4b9e240-d77d-42ed-ac1c-f08d0f3a072d tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:13.829984 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-b4b9e240-d77d-42ed-ac1c-f08d0f3a072d tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfca5c513604cfba864b27067799407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1842fcd00b26484581ba3e681fdc6ecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:46:13.838048 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-b4b9e240-d77d-42ed-ac1c-f08d0f3a072d tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] 10.222.0.62 "GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc" status: 200 len: 1358 microversion: 2.1 time: 0.150562 Aug 10 11:46:13.838612 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 532/1064] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:46:13 2022] GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:46:14.552784 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-070e55e3-d8a0-4b78-9612-151221a9e9e7 req-e94da303-e1fd-4b9f-ad14-2141c927d92e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26420667-2913-420e-a978-d82b57dbb0fc", "name": "network-vif-plugged", "status": "completed", "tag": "664bc1b1-0740-4b33-a697-a2970a2f2249"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:46:14.562459 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-070e55e3-d8a0-4b78-9612-151221a9e9e7 req-e94da303-e1fd-4b9f-ad14-2141c927d92e service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:14.562936 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-070e55e3-d8a0-4b78-9612-151221a9e9e7 req-e94da303-e1fd-4b9f-ad14-2141c927d92e service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:14.563370 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-070e55e3-d8a0-4b78-9612-151221a9e9e7 req-e94da303-e1fd-4b9f-ad14-2141c927d92e service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:14.574567 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-070e55e3-d8a0-4b78-9612-151221a9e9e7 req-e94da303-e1fd-4b9f-ad14-2141c927d92e service nova] Creating event network-vif-plugged:664bc1b1-0740-4b33-a697-a2970a2f2249 for instance 26420667-2913-420e-a978-d82b57dbb0fc on hv-cinder-85272 Aug 10 11:46:14.579464 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-070e55e3-d8a0-4b78-9612-151221a9e9e7 req-e94da303-e1fd-4b9f-ad14-2141c927d92e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030427 Aug 10 11:46:14.580065 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 533/1065] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:46:14.858548 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-57e83238-bc8c-475c-af80-8069298570be tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:46:14.859198 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-57e83238-bc8c-475c-af80-8069298570be tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] [instance: 26420667-2913-420e-a978-d82b57dbb0fc] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:46:14.865303 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-57e83238-bc8c-475c-af80-8069298570be tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:14.865784 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-57e83238-bc8c-475c-af80-8069298570be tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:14.866248 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-57e83238-bc8c-475c-af80-8069298570be tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:14.866949 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-57e83238-bc8c-475c-af80-8069298570be tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:14.867410 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-57e83238-bc8c-475c-af80-8069298570be tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:14.867916 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-57e83238-bc8c-475c-af80-8069298570be tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:14.996311 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-57e83238-bc8c-475c-af80-8069298570be tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfca5c513604cfba864b27067799407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1842fcd00b26484581ba3e681fdc6ecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:46:15.003548 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-57e83238-bc8c-475c-af80-8069298570be tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] 10.222.0.62 "GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc" status: 200 len: 1358 microversion: 2.1 time: 0.148891 Aug 10 11:46:15.004139 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 533/1066] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:46:14 2022] GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:46:16.026135 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-e938b8e4-aa6b-4de7-8038-c5fe6d7ecec9 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:46:16.026838 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-e938b8e4-aa6b-4de7-8038-c5fe6d7ecec9 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] [instance: 26420667-2913-420e-a978-d82b57dbb0fc] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:46:16.033019 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e938b8e4-aa6b-4de7-8038-c5fe6d7ecec9 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:16.033501 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e938b8e4-aa6b-4de7-8038-c5fe6d7ecec9 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:16.033936 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e938b8e4-aa6b-4de7-8038-c5fe6d7ecec9 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:16.034625 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e938b8e4-aa6b-4de7-8038-c5fe6d7ecec9 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:16.035080 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e938b8e4-aa6b-4de7-8038-c5fe6d7ecec9 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:16.035555 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e938b8e4-aa6b-4de7-8038-c5fe6d7ecec9 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:16.171576 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-e938b8e4-aa6b-4de7-8038-c5fe6d7ecec9 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfca5c513604cfba864b27067799407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1842fcd00b26484581ba3e681fdc6ecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:46:16.179628 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-e938b8e4-aa6b-4de7-8038-c5fe6d7ecec9 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] 10.222.0.62 "GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc" status: 200 len: 1547 microversion: 2.1 time: 0.158341 Aug 10 11:46:16.180862 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 534/1067] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:46:16 2022] GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc => generated 1547 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:46:16.203346 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-efa0d140-2ef4-4b20-877c-6762ec99bcf1 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:46:16.203956 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-efa0d140-2ef4-4b20-877c-6762ec99bcf1 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] [instance: 26420667-2913-420e-a978-d82b57dbb0fc] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:46:16.210452 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-efa0d140-2ef4-4b20-877c-6762ec99bcf1 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:16.210926 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-efa0d140-2ef4-4b20-877c-6762ec99bcf1 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:16.211358 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-efa0d140-2ef4-4b20-877c-6762ec99bcf1 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:16.212469 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-efa0d140-2ef4-4b20-877c-6762ec99bcf1 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:16.212945 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-efa0d140-2ef4-4b20-877c-6762ec99bcf1 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:16.213369 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-efa0d140-2ef4-4b20-877c-6762ec99bcf1 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:16.344385 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-efa0d140-2ef4-4b20-877c-6762ec99bcf1 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfca5c513604cfba864b27067799407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1842fcd00b26484581ba3e681fdc6ecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:46:16.351923 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-efa0d140-2ef4-4b20-877c-6762ec99bcf1 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] 10.222.0.62 "GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc" status: 200 len: 1547 microversion: 2.1 time: 0.152565 Aug 10 11:46:16.352780 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 534/1068] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:46:16 2022] GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc => generated 1547 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:46:16.372225 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-b973b759-b5a4-4e7b-a37c-08fc0e918d9c tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:46:16.376944 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b973b759-b5a4-4e7b-a37c-08fc0e918d9c tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4cfca5c513604cfba864b27067799407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1842fcd00b26484581ba3e681fdc6ecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:46:16.377759 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-b973b759-b5a4-4e7b-a37c-08fc0e918d9c tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Searching by: {'deleted': False, 'project_id': '1842fcd00b26484581ba3e681fdc6ecd'} {{(pid=124682) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 11:46:16.385047 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b973b759-b5a4-4e7b-a37c-08fc0e918d9c tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:16.385837 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b973b759-b5a4-4e7b-a37c-08fc0e918d9c tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:16.386101 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b973b759-b5a4-4e7b-a37c-08fc0e918d9c tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:16.386837 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b973b759-b5a4-4e7b-a37c-08fc0e918d9c tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:16.387300 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b973b759-b5a4-4e7b-a37c-08fc0e918d9c tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:16.387736 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b973b759-b5a4-4e7b-a37c-08fc0e918d9c tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:16.479000 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.multi_cell_list [None req-b973b759-b5a4-4e7b-a37c-08fc0e918d9c tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124682) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 11:46:16.575866 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-b973b759-b5a4-4e7b-a37c-08fc0e918d9c tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] 10.222.0.62 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.207821 Aug 10 11:46:16.576391 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 535/1069] 10.222.0.62 () {58 vars in 1125 bytes} [Wed Aug 10 11:46:16 2022] GET /compute/v2.1/servers => generated 342 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:46:16.588277 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-2dc1fbc6-f273-4325-b4d6-841405a591fe tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:46:16.588901 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-2dc1fbc6-f273-4325-b4d6-841405a591fe tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] [instance: 26420667-2913-420e-a978-d82b57dbb0fc] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:46:16.594803 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2dc1fbc6-f273-4325-b4d6-841405a591fe tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:16.595290 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2dc1fbc6-f273-4325-b4d6-841405a591fe tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:16.595731 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2dc1fbc6-f273-4325-b4d6-841405a591fe tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:16.596465 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2dc1fbc6-f273-4325-b4d6-841405a591fe tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:16.596927 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2dc1fbc6-f273-4325-b4d6-841405a591fe tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:16.597359 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2dc1fbc6-f273-4325-b4d6-841405a591fe tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:16.722238 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-2dc1fbc6-f273-4325-b4d6-841405a591fe tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfca5c513604cfba864b27067799407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1842fcd00b26484581ba3e681fdc6ecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:46:16.729923 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-2dc1fbc6-f273-4325-b4d6-841405a591fe tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] 10.222.0.62 "GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc" status: 200 len: 1547 microversion: 2.1 time: 0.146348 Aug 10 11:46:16.730485 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 535/1070] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:46:16 2022] GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc => generated 1547 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:46:18.567544 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-81ce0619-0b93-4f11-938e-03f78df554ba tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "18f95641-1718-4cba-9b1c-770a5082739e"}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:46:18.570498 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-81ce0619-0b93-4f11-938e-03f78df554ba tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] [instance: 26420667-2913-420e-a978-d82b57dbb0fc] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:46:18.577352 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-81ce0619-0b93-4f11-938e-03f78df554ba tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:18.577831 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-81ce0619-0b93-4f11-938e-03f78df554ba tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:18.578266 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-81ce0619-0b93-4f11-938e-03f78df554ba tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:18.578950 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-81ce0619-0b93-4f11-938e-03f78df554ba tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:18.579403 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-81ce0619-0b93-4f11-938e-03f78df554ba tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:18.579824 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-81ce0619-0b93-4f11-938e-03f78df554ba tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:19.292197 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-81ce0619-0b93-4f11-938e-03f78df554ba tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] 10.222.0.62 "POST /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.728272 Aug 10 11:46:19.292803 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 536/1071] 10.222.0.62 () {60 vars in 1323 bytes} [Wed Aug 10 11:46:18 2022] POST /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc/os-volume_attachments => generated 194 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:46:26.861543 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-3f92efa2-849b-49c3-bda3-59e5158ac101 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:46:26.862165 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-3f92efa2-849b-49c3-bda3-59e5158ac101 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] [instance: 26420667-2913-420e-a978-d82b57dbb0fc] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:46:26.864760 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:46:26.865433 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=58 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:46:26.870074 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3f92efa2-849b-49c3-bda3-59e5158ac101 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:26.873275 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3f92efa2-849b-49c3-bda3-59e5158ac101 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:26.873275 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3f92efa2-849b-49c3-bda3-59e5158ac101 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:26.873275 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3f92efa2-849b-49c3-bda3-59e5158ac101 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:26.873275 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3f92efa2-849b-49c3-bda3-59e5158ac101 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:26.873681 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3f92efa2-849b-49c3-bda3-59e5158ac101 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:26.998763 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-3f92efa2-849b-49c3-bda3-59e5158ac101 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfca5c513604cfba864b27067799407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1842fcd00b26484581ba3e681fdc6ecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:46:27.006693 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-3f92efa2-849b-49c3-bda3-59e5158ac101 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] 10.222.0.62 "GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc" status: 200 len: 1593 microversion: 2.1 time: 0.148987 Aug 10 11:46:27.007261 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 536/1072] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:46:26 2022] GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc => generated 1593 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:46:28.988057 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-3b805df9-b1ab-4fc1-913b-6e286877f469 req-7d3b310f-b179-4397-a9a5-618f968a17da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26420667-2913-420e-a978-d82b57dbb0fc", "tag": "664bc1b1-0740-4b33-a697-a2970a2f2249"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:46:28.993409 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=2 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:46:28.994032 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:46:29.000458 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-3b805df9-b1ab-4fc1-913b-6e286877f469 req-7d3b310f-b179-4397-a9a5-618f968a17da service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:29.000945 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-3b805df9-b1ab-4fc1-913b-6e286877f469 req-7d3b310f-b179-4397-a9a5-618f968a17da service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:29.001382 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-3b805df9-b1ab-4fc1-913b-6e286877f469 req-7d3b310f-b179-4397-a9a5-618f968a17da service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:29.012718 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:46:29.014953 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-3b805df9-b1ab-4fc1-913b-6e286877f469 req-7d3b310f-b179-4397-a9a5-618f968a17da service nova] Creating event network-changed:664bc1b1-0740-4b33-a697-a2970a2f2249 for instance 26420667-2913-420e-a978-d82b57dbb0fc on hv-cinder-85272 Aug 10 11:46:29.020486 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-3b805df9-b1ab-4fc1-913b-6e286877f469 req-7d3b310f-b179-4397-a9a5-618f968a17da service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037559 Aug 10 11:46:29.022519 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 537/1073] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:46:31.498851 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-236bd8bc-7302-4c37-bc71-32a28da70409 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-469385156"}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:46:31.499396 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-236bd8bc-7302-4c37-bc71-32a28da70409 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] [instance: 26420667-2913-420e-a978-d82b57dbb0fc] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:46:31.505720 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-236bd8bc-7302-4c37-bc71-32a28da70409 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:31.508195 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-236bd8bc-7302-4c37-bc71-32a28da70409 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:31.508195 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-236bd8bc-7302-4c37-bc71-32a28da70409 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:31.508195 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-236bd8bc-7302-4c37-bc71-32a28da70409 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:31.508195 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-236bd8bc-7302-4c37-bc71-32a28da70409 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:31.508590 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-236bd8bc-7302-4c37-bc71-32a28da70409 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:31.633324 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.network.security_group_api [None req-236bd8bc-7302-4c37-bc71-32a28da70409 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Adding security group ece17821-87f6-4bd4-8b5c-0bbd2ef95de9 to port 664bc1b1-0740-4b33-a697-a2970a2f2249 Aug 10 11:46:32.266800 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-236bd8bc-7302-4c37-bc71-32a28da70409 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] 10.222.0.62 "POST /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc/action" status: 202 len: 0 microversion: 2.1 time: 0.771493 Aug 10 11:46:32.266800 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 537/1074] 10.222.0.62 () {60 vars in 1278 bytes} [Wed Aug 10 11:46:31 2022] POST /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc/action => generated 0 bytes in 773 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:46:32.274842 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-52fd7091-88b8-4dfa-b015-fc619f123046 req-e5f15c4b-6fd1-4fe0-a9e0-db9fa97955ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26420667-2913-420e-a978-d82b57dbb0fc", "tag": "664bc1b1-0740-4b33-a697-a2970a2f2249"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:46:32.280723 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-18da83fc-24bc-4592-af8a-c31a727a3f2d tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:46:32.281337 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-18da83fc-24bc-4592-af8a-c31a727a3f2d tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] [instance: 26420667-2913-420e-a978-d82b57dbb0fc] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:46:32.295225 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-18da83fc-24bc-4592-af8a-c31a727a3f2d tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:32.295946 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-18da83fc-24bc-4592-af8a-c31a727a3f2d tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:32.296201 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-18da83fc-24bc-4592-af8a-c31a727a3f2d tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:32.296916 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-18da83fc-24bc-4592-af8a-c31a727a3f2d tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:32.297374 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-18da83fc-24bc-4592-af8a-c31a727a3f2d tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:32.297773 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-52fd7091-88b8-4dfa-b015-fc619f123046 req-e5f15c4b-6fd1-4fe0-a9e0-db9fa97955ca service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:32.297897 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-18da83fc-24bc-4592-af8a-c31a727a3f2d tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:32.298380 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-52fd7091-88b8-4dfa-b015-fc619f123046 req-e5f15c4b-6fd1-4fe0-a9e0-db9fa97955ca service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:32.298817 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-52fd7091-88b8-4dfa-b015-fc619f123046 req-e5f15c4b-6fd1-4fe0-a9e0-db9fa97955ca service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:32.310551 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-52fd7091-88b8-4dfa-b015-fc619f123046 req-e5f15c4b-6fd1-4fe0-a9e0-db9fa97955ca service nova] Creating event network-changed:664bc1b1-0740-4b33-a697-a2970a2f2249 for instance 26420667-2913-420e-a978-d82b57dbb0fc on hv-cinder-85272 Aug 10 11:46:32.315649 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-52fd7091-88b8-4dfa-b015-fc619f123046 req-e5f15c4b-6fd1-4fe0-a9e0-db9fa97955ca service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044611 Aug 10 11:46:32.316607 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 538/1075] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:46:32.487513 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-18da83fc-24bc-4592-af8a-c31a727a3f2d tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfca5c513604cfba864b27067799407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1842fcd00b26484581ba3e681fdc6ecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:46:32.499156 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-18da83fc-24bc-4592-af8a-c31a727a3f2d tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] 10.222.0.62 "GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc" status: 200 len: 1757 microversion: 2.1 time: 0.222718 Aug 10 11:46:32.500243 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 538/1076] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:46:32 2022] GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc => generated 1757 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:46:49.316012 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-b5845f4c-dc0d-4638-84e7-8a66ca6b0a8c tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:46:49.318331 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-b5845f4c-dc0d-4638-84e7-8a66ca6b0a8c tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] [instance: 26420667-2913-420e-a978-d82b57dbb0fc] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:46:49.325384 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b5845f4c-dc0d-4638-84e7-8a66ca6b0a8c tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:49.325869 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b5845f4c-dc0d-4638-84e7-8a66ca6b0a8c tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:49.326310 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b5845f4c-dc0d-4638-84e7-8a66ca6b0a8c tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:49.327000 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b5845f4c-dc0d-4638-84e7-8a66ca6b0a8c tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:49.327459 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b5845f4c-dc0d-4638-84e7-8a66ca6b0a8c tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:49.327890 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b5845f4c-dc0d-4638-84e7-8a66ca6b0a8c tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:49.577937 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-b5845f4c-dc0d-4638-84e7-8a66ca6b0a8c tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] 10.222.0.62 "POST /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc/action" status: 202 len: 0 microversion: 2.1 time: 0.266877 Aug 10 11:46:49.578756 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 539/1077] 10.222.0.62 () {60 vars in 1278 bytes} [Wed Aug 10 11:46:49 2022] POST /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:46:49.587282 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-9a555590-2172-4e43-beee-70c311128e56 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:46:49.588051 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-9a555590-2172-4e43-beee-70c311128e56 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] [instance: 26420667-2913-420e-a978-d82b57dbb0fc] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:46:49.590751 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=6 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:46:49.591415 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=16 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:46:49.596088 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9a555590-2172-4e43-beee-70c311128e56 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:49.596584 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9a555590-2172-4e43-beee-70c311128e56 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:49.597024 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9a555590-2172-4e43-beee-70c311128e56 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:49.597717 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9a555590-2172-4e43-beee-70c311128e56 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:49.598174 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9a555590-2172-4e43-beee-70c311128e56 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:49.598597 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9a555590-2172-4e43-beee-70c311128e56 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:49.744218 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-9a555590-2172-4e43-beee-70c311128e56 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfca5c513604cfba864b27067799407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1842fcd00b26484581ba3e681fdc6ecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:46:49.752970 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-9a555590-2172-4e43-beee-70c311128e56 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] 10.222.0.62 "GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc" status: 200 len: 1749 microversion: 2.1 time: 0.169493 Aug 10 11:46:49.753745 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 539/1078] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:46:49 2022] GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc => generated 1749 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:46:50.775758 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-59fa2f8b-eace-4954-82ba-925aa32224b2 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:46:50.776397 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-59fa2f8b-eace-4954-82ba-925aa32224b2 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] [instance: 26420667-2913-420e-a978-d82b57dbb0fc] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:46:50.782501 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-59fa2f8b-eace-4954-82ba-925aa32224b2 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:50.782977 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-59fa2f8b-eace-4954-82ba-925aa32224b2 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:50.783412 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-59fa2f8b-eace-4954-82ba-925aa32224b2 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:50.784406 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-59fa2f8b-eace-4954-82ba-925aa32224b2 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:50.784865 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-59fa2f8b-eace-4954-82ba-925aa32224b2 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:50.785287 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-59fa2f8b-eace-4954-82ba-925aa32224b2 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:50.923398 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-59fa2f8b-eace-4954-82ba-925aa32224b2 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfca5c513604cfba864b27067799407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1842fcd00b26484581ba3e681fdc6ecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:46:50.931897 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-59fa2f8b-eace-4954-82ba-925aa32224b2 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] 10.222.0.62 "GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc" status: 200 len: 1754 microversion: 2.1 time: 0.160865 Aug 10 11:46:50.932481 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 540/1079] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:46:50 2022] GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:46:51.954817 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-3de8c660-7513-42eb-8c7b-08872e239825 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:46:51.955422 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-3de8c660-7513-42eb-8c7b-08872e239825 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] [instance: 26420667-2913-420e-a978-d82b57dbb0fc] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:46:51.962454 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3de8c660-7513-42eb-8c7b-08872e239825 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:51.962940 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3de8c660-7513-42eb-8c7b-08872e239825 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:51.963377 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3de8c660-7513-42eb-8c7b-08872e239825 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:51.964103 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3de8c660-7513-42eb-8c7b-08872e239825 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:51.964558 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3de8c660-7513-42eb-8c7b-08872e239825 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:51.965642 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3de8c660-7513-42eb-8c7b-08872e239825 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:52.120366 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-3de8c660-7513-42eb-8c7b-08872e239825 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfca5c513604cfba864b27067799407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1842fcd00b26484581ba3e681fdc6ecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:46:52.128923 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-3de8c660-7513-42eb-8c7b-08872e239825 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] 10.222.0.62 "GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc" status: 200 len: 1754 microversion: 2.1 time: 0.178372 Aug 10 11:46:52.130003 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 540/1080] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:46:51 2022] GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc => generated 1754 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:46:53.150607 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-88dad8fa-e075-46f1-b1fe-026b5c9d94e2 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:46:53.151243 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-88dad8fa-e075-46f1-b1fe-026b5c9d94e2 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] [instance: 26420667-2913-420e-a978-d82b57dbb0fc] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:46:53.158598 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-88dad8fa-e075-46f1-b1fe-026b5c9d94e2 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:53.159081 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-88dad8fa-e075-46f1-b1fe-026b5c9d94e2 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:53.159514 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-88dad8fa-e075-46f1-b1fe-026b5c9d94e2 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:53.160226 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-88dad8fa-e075-46f1-b1fe-026b5c9d94e2 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:53.160677 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-88dad8fa-e075-46f1-b1fe-026b5c9d94e2 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:53.161100 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-88dad8fa-e075-46f1-b1fe-026b5c9d94e2 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:53.312688 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-88dad8fa-e075-46f1-b1fe-026b5c9d94e2 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfca5c513604cfba864b27067799407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1842fcd00b26484581ba3e681fdc6ecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:46:53.320431 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-88dad8fa-e075-46f1-b1fe-026b5c9d94e2 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] 10.222.0.62 "GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc" status: 200 len: 1754 microversion: 2.1 time: 0.173708 Aug 10 11:46:53.320990 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 541/1081] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:46:53 2022] GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc => generated 1754 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:46:54.342579 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-0a66d2eb-31f0-4589-8a4c-e56e11ca6017 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:46:54.343179 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-0a66d2eb-31f0-4589-8a4c-e56e11ca6017 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] [instance: 26420667-2913-420e-a978-d82b57dbb0fc] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:46:54.349575 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0a66d2eb-31f0-4589-8a4c-e56e11ca6017 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:54.350054 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0a66d2eb-31f0-4589-8a4c-e56e11ca6017 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:54.350483 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0a66d2eb-31f0-4589-8a4c-e56e11ca6017 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:54.351167 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0a66d2eb-31f0-4589-8a4c-e56e11ca6017 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:54.351616 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0a66d2eb-31f0-4589-8a4c-e56e11ca6017 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:54.352063 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0a66d2eb-31f0-4589-8a4c-e56e11ca6017 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:54.492889 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-0a66d2eb-31f0-4589-8a4c-e56e11ca6017 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfca5c513604cfba864b27067799407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1842fcd00b26484581ba3e681fdc6ecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:46:54.501331 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-0a66d2eb-31f0-4589-8a4c-e56e11ca6017 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] 10.222.0.62 "GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc" status: 200 len: 1754 microversion: 2.1 time: 0.163254 Aug 10 11:46:54.501878 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 541/1082] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:46:54 2022] GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:46:55.522770 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-cec7fa12-1ca3-486c-99c3-91cdcf428ba8 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:46:55.523316 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-cec7fa12-1ca3-486c-99c3-91cdcf428ba8 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] [instance: 26420667-2913-420e-a978-d82b57dbb0fc] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:46:55.529869 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cec7fa12-1ca3-486c-99c3-91cdcf428ba8 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:55.530342 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cec7fa12-1ca3-486c-99c3-91cdcf428ba8 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:55.530773 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cec7fa12-1ca3-486c-99c3-91cdcf428ba8 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:55.531455 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cec7fa12-1ca3-486c-99c3-91cdcf428ba8 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:55.531927 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cec7fa12-1ca3-486c-99c3-91cdcf428ba8 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:55.532374 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cec7fa12-1ca3-486c-99c3-91cdcf428ba8 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:55.920558 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-cec7fa12-1ca3-486c-99c3-91cdcf428ba8 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfca5c513604cfba864b27067799407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1842fcd00b26484581ba3e681fdc6ecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:46:55.928594 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-cec7fa12-1ca3-486c-99c3-91cdcf428ba8 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] 10.222.0.62 "GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc" status: 200 len: 1754 microversion: 2.1 time: 0.409775 Aug 10 11:46:55.929207 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 542/1083] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:46:55 2022] GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc => generated 1754 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:46:56.951052 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-87f474f5-5fb2-4aec-a5f9-3842b6d99bb2 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:46:56.951661 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-87f474f5-5fb2-4aec-a5f9-3842b6d99bb2 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] [instance: 26420667-2913-420e-a978-d82b57dbb0fc] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:46:56.958350 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-87f474f5-5fb2-4aec-a5f9-3842b6d99bb2 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:56.958841 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-87f474f5-5fb2-4aec-a5f9-3842b6d99bb2 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:56.959284 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-87f474f5-5fb2-4aec-a5f9-3842b6d99bb2 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:56.960002 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-87f474f5-5fb2-4aec-a5f9-3842b6d99bb2 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:56.960471 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-87f474f5-5fb2-4aec-a5f9-3842b6d99bb2 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:56.960904 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-87f474f5-5fb2-4aec-a5f9-3842b6d99bb2 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:57.105305 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-87f474f5-5fb2-4aec-a5f9-3842b6d99bb2 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfca5c513604cfba864b27067799407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1842fcd00b26484581ba3e681fdc6ecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:46:57.113486 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-87f474f5-5fb2-4aec-a5f9-3842b6d99bb2 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] 10.222.0.62 "GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc" status: 200 len: 1754 microversion: 2.1 time: 0.167076 Aug 10 11:46:57.114062 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 542/1084] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:46:56 2022] GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:46:58.134579 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-bea6976b-a47a-4d97-a874-e2f9edfe784f tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:46:58.135196 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-bea6976b-a47a-4d97-a874-e2f9edfe784f tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] [instance: 26420667-2913-420e-a978-d82b57dbb0fc] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:46:58.142132 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bea6976b-a47a-4d97-a874-e2f9edfe784f tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:58.142609 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bea6976b-a47a-4d97-a874-e2f9edfe784f tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:58.143034 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bea6976b-a47a-4d97-a874-e2f9edfe784f tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:58.143714 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bea6976b-a47a-4d97-a874-e2f9edfe784f tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:58.144207 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bea6976b-a47a-4d97-a874-e2f9edfe784f tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:58.144629 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bea6976b-a47a-4d97-a874-e2f9edfe784f tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:58.286272 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-bea6976b-a47a-4d97-a874-e2f9edfe784f tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfca5c513604cfba864b27067799407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1842fcd00b26484581ba3e681fdc6ecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:46:58.294973 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-bea6976b-a47a-4d97-a874-e2f9edfe784f tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] 10.222.0.62 "GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc" status: 200 len: 1754 microversion: 2.1 time: 0.164303 Aug 10 11:46:58.295560 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 543/1085] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:46:58 2022] GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:46:59.316977 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-6d768a54-198b-4459-ada2-c42ed19a40d9 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:46:59.317607 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-6d768a54-198b-4459-ada2-c42ed19a40d9 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] [instance: 26420667-2913-420e-a978-d82b57dbb0fc] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:46:59.324825 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6d768a54-198b-4459-ada2-c42ed19a40d9 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:59.330229 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6d768a54-198b-4459-ada2-c42ed19a40d9 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:59.330229 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6d768a54-198b-4459-ada2-c42ed19a40d9 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:59.330229 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6d768a54-198b-4459-ada2-c42ed19a40d9 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:46:59.330229 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6d768a54-198b-4459-ada2-c42ed19a40d9 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:46:59.330665 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6d768a54-198b-4459-ada2-c42ed19a40d9 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:46:59.470241 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-6d768a54-198b-4459-ada2-c42ed19a40d9 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfca5c513604cfba864b27067799407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1842fcd00b26484581ba3e681fdc6ecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:46:59.478129 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-6d768a54-198b-4459-ada2-c42ed19a40d9 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] 10.222.0.62 "GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc" status: 200 len: 1754 microversion: 2.1 time: 0.165081 Aug 10 11:46:59.478701 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 543/1086] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:46:59 2022] GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:47:00.498727 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-d96808d7-ef8f-4234-bc41-6773a90e2fd7 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:47:00.499367 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-d96808d7-ef8f-4234-bc41-6773a90e2fd7 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] [instance: 26420667-2913-420e-a978-d82b57dbb0fc] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:47:00.505700 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d96808d7-ef8f-4234-bc41-6773a90e2fd7 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:47:00.506171 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d96808d7-ef8f-4234-bc41-6773a90e2fd7 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:47:00.506602 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d96808d7-ef8f-4234-bc41-6773a90e2fd7 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:47:00.507276 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d96808d7-ef8f-4234-bc41-6773a90e2fd7 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:47:00.507724 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d96808d7-ef8f-4234-bc41-6773a90e2fd7 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:47:00.508176 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d96808d7-ef8f-4234-bc41-6773a90e2fd7 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:47:00.648345 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-d96808d7-ef8f-4234-bc41-6773a90e2fd7 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfca5c513604cfba864b27067799407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1842fcd00b26484581ba3e681fdc6ecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:47:00.657444 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-d96808d7-ef8f-4234-bc41-6773a90e2fd7 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] 10.222.0.62 "GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc" status: 200 len: 1754 microversion: 2.1 time: 0.162712 Aug 10 11:47:00.657996 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 544/1087] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:47:00 2022] GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:47:01.686585 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-86efca70-7d76-4a2c-b7d5-44567e714640 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:47:01.687189 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-86efca70-7d76-4a2c-b7d5-44567e714640 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] [instance: 26420667-2913-420e-a978-d82b57dbb0fc] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:47:01.693672 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-86efca70-7d76-4a2c-b7d5-44567e714640 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:47:01.694157 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-86efca70-7d76-4a2c-b7d5-44567e714640 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:47:01.694595 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-86efca70-7d76-4a2c-b7d5-44567e714640 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:47:01.695285 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-86efca70-7d76-4a2c-b7d5-44567e714640 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:47:01.695740 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-86efca70-7d76-4a2c-b7d5-44567e714640 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:47:01.696197 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-86efca70-7d76-4a2c-b7d5-44567e714640 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:47:01.834717 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-86efca70-7d76-4a2c-b7d5-44567e714640 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfca5c513604cfba864b27067799407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1842fcd00b26484581ba3e681fdc6ecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:47:01.843430 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-86efca70-7d76-4a2c-b7d5-44567e714640 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] 10.222.0.62 "GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc" status: 200 len: 1754 microversion: 2.1 time: 0.161384 Aug 10 11:47:01.844011 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 544/1088] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:47:01 2022] GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:47:02.864777 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-c2e3fbb5-ffb9-4496-875f-2f54c47bf94a tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:47:02.865421 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-c2e3fbb5-ffb9-4496-875f-2f54c47bf94a tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] [instance: 26420667-2913-420e-a978-d82b57dbb0fc] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:47:02.871844 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c2e3fbb5-ffb9-4496-875f-2f54c47bf94a tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:47:02.872354 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c2e3fbb5-ffb9-4496-875f-2f54c47bf94a tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:47:02.872814 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c2e3fbb5-ffb9-4496-875f-2f54c47bf94a tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:47:02.873503 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c2e3fbb5-ffb9-4496-875f-2f54c47bf94a tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:47:02.873953 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c2e3fbb5-ffb9-4496-875f-2f54c47bf94a tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:47:02.874377 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c2e3fbb5-ffb9-4496-875f-2f54c47bf94a tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:47:03.014994 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c2e3fbb5-ffb9-4496-875f-2f54c47bf94a tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfca5c513604cfba864b27067799407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1842fcd00b26484581ba3e681fdc6ecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:47:03.023088 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-c2e3fbb5-ffb9-4496-875f-2f54c47bf94a tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] 10.222.0.62 "GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc" status: 200 len: 1754 microversion: 2.1 time: 0.162112 Aug 10 11:47:03.023653 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 545/1089] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:47:02 2022] GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:47:04.045629 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-c02e0fc1-cfae-42c9-a11e-c423ccee1958 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:47:04.046242 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-c02e0fc1-cfae-42c9-a11e-c423ccee1958 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] [instance: 26420667-2913-420e-a978-d82b57dbb0fc] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:47:04.052614 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c02e0fc1-cfae-42c9-a11e-c423ccee1958 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:47:04.053091 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c02e0fc1-cfae-42c9-a11e-c423ccee1958 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:47:04.053525 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c02e0fc1-cfae-42c9-a11e-c423ccee1958 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:47:04.054218 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c02e0fc1-cfae-42c9-a11e-c423ccee1958 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:47:04.054669 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c02e0fc1-cfae-42c9-a11e-c423ccee1958 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:47:04.055097 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c02e0fc1-cfae-42c9-a11e-c423ccee1958 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:47:04.199074 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-c02e0fc1-cfae-42c9-a11e-c423ccee1958 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfca5c513604cfba864b27067799407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1842fcd00b26484581ba3e681fdc6ecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:47:04.207170 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-c02e0fc1-cfae-42c9-a11e-c423ccee1958 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] 10.222.0.62 "GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc" status: 200 len: 1754 microversion: 2.1 time: 0.166224 Aug 10 11:47:04.207741 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 545/1090] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:47:04 2022] GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:47:05.230616 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-6ccaeff6-f2ac-4222-a277-b7169dba8b11 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:47:05.231422 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-6ccaeff6-f2ac-4222-a277-b7169dba8b11 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] [instance: 26420667-2913-420e-a978-d82b57dbb0fc] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:47:05.237858 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6ccaeff6-f2ac-4222-a277-b7169dba8b11 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:47:05.238340 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6ccaeff6-f2ac-4222-a277-b7169dba8b11 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:47:05.238798 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6ccaeff6-f2ac-4222-a277-b7169dba8b11 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:47:05.239478 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6ccaeff6-f2ac-4222-a277-b7169dba8b11 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:47:05.239927 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6ccaeff6-f2ac-4222-a277-b7169dba8b11 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:47:05.240370 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6ccaeff6-f2ac-4222-a277-b7169dba8b11 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:47:05.383947 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-6ccaeff6-f2ac-4222-a277-b7169dba8b11 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfca5c513604cfba864b27067799407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1842fcd00b26484581ba3e681fdc6ecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:47:05.392498 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-6ccaeff6-f2ac-4222-a277-b7169dba8b11 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] 10.222.0.62 "GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc" status: 200 len: 1754 microversion: 2.1 time: 0.165874 Aug 10 11:47:05.393069 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 546/1091] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:47:05 2022] GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:47:06.412569 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-0f68551a-03f8-4765-873f-5a5271a03d7f tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:47:06.413177 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-0f68551a-03f8-4765-873f-5a5271a03d7f tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] [instance: 26420667-2913-420e-a978-d82b57dbb0fc] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:47:06.419604 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0f68551a-03f8-4765-873f-5a5271a03d7f tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:47:06.420130 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0f68551a-03f8-4765-873f-5a5271a03d7f tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:47:06.420574 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0f68551a-03f8-4765-873f-5a5271a03d7f tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:47:06.421269 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0f68551a-03f8-4765-873f-5a5271a03d7f tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:47:06.421731 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0f68551a-03f8-4765-873f-5a5271a03d7f tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:47:06.422165 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0f68551a-03f8-4765-873f-5a5271a03d7f tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:47:06.564608 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-0f68551a-03f8-4765-873f-5a5271a03d7f tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfca5c513604cfba864b27067799407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1842fcd00b26484581ba3e681fdc6ecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:47:06.572674 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-0f68551a-03f8-4765-873f-5a5271a03d7f tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] 10.222.0.62 "GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc" status: 200 len: 1754 microversion: 2.1 time: 0.164012 Aug 10 11:47:06.573233 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 546/1092] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:47:06 2022] GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:47:07.593438 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-96db7557-7260-4f1e-bada-c8dc3055df4c tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:47:07.594054 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-96db7557-7260-4f1e-bada-c8dc3055df4c tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] [instance: 26420667-2913-420e-a978-d82b57dbb0fc] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:47:07.600464 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-96db7557-7260-4f1e-bada-c8dc3055df4c tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:47:07.600941 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-96db7557-7260-4f1e-bada-c8dc3055df4c tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:47:07.601374 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-96db7557-7260-4f1e-bada-c8dc3055df4c tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:47:07.602096 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-96db7557-7260-4f1e-bada-c8dc3055df4c tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:47:07.602550 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-96db7557-7260-4f1e-bada-c8dc3055df4c tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:47:07.602974 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-96db7557-7260-4f1e-bada-c8dc3055df4c tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:47:07.741384 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-96db7557-7260-4f1e-bada-c8dc3055df4c tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfca5c513604cfba864b27067799407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1842fcd00b26484581ba3e681fdc6ecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:47:07.749830 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-96db7557-7260-4f1e-bada-c8dc3055df4c tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] 10.222.0.62 "GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc" status: 200 len: 1757 microversion: 2.1 time: 0.160794 Aug 10 11:47:07.750389 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 547/1093] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:47:07 2022] GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:47:38.666906 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-1761570a-a35a-49f0-81af-abc0206b58b0 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-469385156"}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:47:38.667554 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-1761570a-a35a-49f0-81af-abc0206b58b0 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] [instance: 26420667-2913-420e-a978-d82b57dbb0fc] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:47:38.670073 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=16 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:47:38.670730 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=48 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:47:38.675390 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1761570a-a35a-49f0-81af-abc0206b58b0 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:47:38.680255 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1761570a-a35a-49f0-81af-abc0206b58b0 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:47:38.680255 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1761570a-a35a-49f0-81af-abc0206b58b0 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:47:38.680255 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1761570a-a35a-49f0-81af-abc0206b58b0 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:47:38.680255 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1761570a-a35a-49f0-81af-abc0206b58b0 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:47:38.680647 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1761570a-a35a-49f0-81af-abc0206b58b0 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:47:38.806172 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.network.security_group_api [None req-1761570a-a35a-49f0-81af-abc0206b58b0 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Removing security group ece17821-87f6-4bd4-8b5c-0bbd2ef95de9 from port 664bc1b1-0740-4b33-a697-a2970a2f2249 Aug 10 11:47:39.303891 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-1761570a-a35a-49f0-81af-abc0206b58b0 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] 10.222.0.62 "POST /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc/action" status: 202 len: 0 microversion: 2.1 time: 0.641030 Aug 10 11:47:39.304914 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 547/1094] 10.222.0.62 () {60 vars in 1278 bytes} [Wed Aug 10 11:47:38 2022] POST /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc/action => generated 0 bytes in 643 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 11:47:39.312170 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-4215f56f-4aa5-4da3-b84e-73875e3e4b23 req-6c0b80a7-4e3f-4f7e-801a-693cb4c95fb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26420667-2913-420e-a978-d82b57dbb0fc", "tag": "664bc1b1-0740-4b33-a697-a2970a2f2249"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:47:39.320887 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=22 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:47:39.321633 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:47:39.325976 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-4215f56f-4aa5-4da3-b84e-73875e3e4b23 req-6c0b80a7-4e3f-4f7e-801a-693cb4c95fb7 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:47:39.326476 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-4215f56f-4aa5-4da3-b84e-73875e3e4b23 req-6c0b80a7-4e3f-4f7e-801a-693cb4c95fb7 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:47:39.326895 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-4215f56f-4aa5-4da3-b84e-73875e3e4b23 req-6c0b80a7-4e3f-4f7e-801a-693cb4c95fb7 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:47:39.340576 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-4215f56f-4aa5-4da3-b84e-73875e3e4b23 req-6c0b80a7-4e3f-4f7e-801a-693cb4c95fb7 service nova] Creating event network-changed:664bc1b1-0740-4b33-a697-a2970a2f2249 for instance 26420667-2913-420e-a978-d82b57dbb0fc on hv-cinder-85272 Aug 10 11:47:39.347665 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-4215f56f-4aa5-4da3-b84e-73875e3e4b23 req-6c0b80a7-4e3f-4f7e-801a-693cb4c95fb7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040302 Aug 10 11:47:39.349175 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 548/1095] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:47:40.606159 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-1e05129f-33b8-416a-9f51-74c18f66bd58 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:47:40.607150 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-1e05129f-33b8-416a-9f51-74c18f66bd58 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] [instance: 26420667-2913-420e-a978-d82b57dbb0fc] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:47:40.612913 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1e05129f-33b8-416a-9f51-74c18f66bd58 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:47:40.615941 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1e05129f-33b8-416a-9f51-74c18f66bd58 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:47:40.615941 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1e05129f-33b8-416a-9f51-74c18f66bd58 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:47:40.615941 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1e05129f-33b8-416a-9f51-74c18f66bd58 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:47:40.615941 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1e05129f-33b8-416a-9f51-74c18f66bd58 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:47:40.616338 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1e05129f-33b8-416a-9f51-74c18f66bd58 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:47:40.701413 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.objects.instance [None req-1e05129f-33b8-416a-9f51-74c18f66bd58 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lazy-loading 'services' on Instance uuid 26420667-2913-420e-a978-d82b57dbb0fc {{(pid=124683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:47:41.183741 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-1e05129f-33b8-416a-9f51-74c18f66bd58 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] 10.222.0.62 "DELETE /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc/os-volume_attachments/18f95641-1718-4cba-9b1c-770a5082739e" status: 202 len: 0 microversion: 2.1 time: 0.581813 Aug 10 11:47:41.184366 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 548/1096] 10.222.0.62 () {58 vars in 1416 bytes} [Wed Aug 10 11:47:40 2022] DELETE /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc/os-volume_attachments/18f95641-1718-4cba-9b1c-770a5082739e => generated 0 bytes in 583 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:47:41.193881 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-5e83523e-1422-4d9e-9bab-0dc8da92d2ef tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:47:41.196472 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-5e83523e-1422-4d9e-9bab-0dc8da92d2ef tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] [instance: 26420667-2913-420e-a978-d82b57dbb0fc] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:47:41.204596 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5e83523e-1422-4d9e-9bab-0dc8da92d2ef tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:47:41.205082 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5e83523e-1422-4d9e-9bab-0dc8da92d2ef tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:47:41.205517 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5e83523e-1422-4d9e-9bab-0dc8da92d2ef tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:47:41.206212 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5e83523e-1422-4d9e-9bab-0dc8da92d2ef tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:47:41.206666 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5e83523e-1422-4d9e-9bab-0dc8da92d2ef tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:47:41.207094 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5e83523e-1422-4d9e-9bab-0dc8da92d2ef tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:47:41.236877 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-5e83523e-1422-4d9e-9bab-0dc8da92d2ef tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] 10.222.0.62 "GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047721 Aug 10 11:47:41.237363 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 549/1097] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 10 11:47:41 2022] GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:47:41.364308 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-6494156b-bd06-48eb-a19e-3ee4d674127a req-f585675a-a276-43e4-9246-6bc00679b41e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26420667-2913-420e-a978-d82b57dbb0fc", "tag": "664bc1b1-0740-4b33-a697-a2970a2f2249"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:47:41.374907 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-6494156b-bd06-48eb-a19e-3ee4d674127a req-f585675a-a276-43e4-9246-6bc00679b41e service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:47:41.375387 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-6494156b-bd06-48eb-a19e-3ee4d674127a req-f585675a-a276-43e4-9246-6bc00679b41e service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:47:41.375820 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-6494156b-bd06-48eb-a19e-3ee4d674127a req-f585675a-a276-43e4-9246-6bc00679b41e service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:47:41.388334 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-6494156b-bd06-48eb-a19e-3ee4d674127a req-f585675a-a276-43e4-9246-6bc00679b41e service nova] Creating event network-changed:664bc1b1-0740-4b33-a697-a2970a2f2249 for instance 26420667-2913-420e-a978-d82b57dbb0fc on hv-cinder-85272 Aug 10 11:47:41.400177 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-6494156b-bd06-48eb-a19e-3ee4d674127a req-f585675a-a276-43e4-9246-6bc00679b41e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033812 Aug 10 11:47:41.400177 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 549/1098] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:47:42.250596 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-0be3a7db-bfdb-4d26-b462-e0826235442a tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:47:42.252823 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-0be3a7db-bfdb-4d26-b462-e0826235442a tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] [instance: 26420667-2913-420e-a978-d82b57dbb0fc] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:47:42.259503 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0be3a7db-bfdb-4d26-b462-e0826235442a tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:47:42.260017 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0be3a7db-bfdb-4d26-b462-e0826235442a tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:47:42.260452 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0be3a7db-bfdb-4d26-b462-e0826235442a tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:47:42.261140 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0be3a7db-bfdb-4d26-b462-e0826235442a tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:47:42.261634 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0be3a7db-bfdb-4d26-b462-e0826235442a tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:47:42.262061 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0be3a7db-bfdb-4d26-b462-e0826235442a tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:47:42.291937 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-0be3a7db-bfdb-4d26-b462-e0826235442a tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] 10.222.0.62 "GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046334 Aug 10 11:47:42.292773 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 550/1099] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 10 11:47:42 2022] GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 11:47:42.305621 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-7e64eeac-394a-4b75-a292-2f1d21dd9456 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:47:42.306174 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-7e64eeac-394a-4b75-a292-2f1d21dd9456 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] [instance: 26420667-2913-420e-a978-d82b57dbb0fc] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:47:42.312955 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7e64eeac-394a-4b75-a292-2f1d21dd9456 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:47:42.313440 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7e64eeac-394a-4b75-a292-2f1d21dd9456 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:47:42.313882 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7e64eeac-394a-4b75-a292-2f1d21dd9456 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:47:42.314577 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7e64eeac-394a-4b75-a292-2f1d21dd9456 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:47:42.315038 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7e64eeac-394a-4b75-a292-2f1d21dd9456 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:47:42.315467 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7e64eeac-394a-4b75-a292-2f1d21dd9456 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:47:42.389980 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-7e64eeac-394a-4b75-a292-2f1d21dd9456 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] HTTP exception thrown: Instance 26420667-2913-420e-a978-d82b57dbb0fc is not attached to volume 18f95641-1718-4cba-9b1c-770a5082739e Aug 10 11:47:42.392959 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-7e64eeac-394a-4b75-a292-2f1d21dd9456 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Request method failure captured: Aug 10 11:47:42.392959 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: request: DELETE /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc/os-volume_attachments/18f95641-1718-4cba-9b1c-770a5082739e HTTP/1.1 Aug 10 11:47:42.392959 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept: application/json Aug 10 11:47:42.392959 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Aug 10 11:47:42.392959 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Connection: close Aug 10 11:47:42.392959 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Length: 0 Aug 10 11:47:42.392959 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Type: application/json Aug 10 11:47:42.392959 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Host: 10.222.0.62 Aug 10 11:47:42.392959 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Aug 10 11:47:42.392959 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.11 Aug 10 11:47:42.392959 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABi85phy23f4aAZWo7YNWVa_92iQqiUtOCjJ7zLUroYCQENWswxqO3pNhSTCB1IHN1i_dO-7orr0vHFwxvNgiysk587VuYzfLEv9lABxoMLcHpQ4epPww2OB15Oi890IjQJV-NuQwkS022CdpGWgFOwpb42JNzdY0m2f1cOpZ6w3nMDaFk Aug 10 11:47:42.392959 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Aug 10 11:47:42.392959 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Aug 10 11:47:42.392959 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Aug 10 11:47:42.392959 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Aug 10 11:47:42.392959 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Aug 10 11:47:42.392959 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Aug 10 11:47:42.392959 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Id: 1842fcd00b26484581ba3e681fdc6ecd Aug 10 11:47:42.392959 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-TestMinimumBasicScenario-2114976808 Aug 10 11:47:42.392959 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Role: member,reader Aug 10 11:47:42.392959 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Aug 10 11:47:42.394866 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1842fcd00b26484581ba3e681fdc6ecd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1842fcd00b26484581ba3e681fdc6ecd", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1842fcd00b26484581ba3e681fdc6ecd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1842fcd00b26484581ba3e681fdc6ecd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:47:42.394866 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-TestMinimumBasicScenario-2114976808 Aug 10 11:47:42.394866 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Id: 1842fcd00b26484581ba3e681fdc6ecd Aug 10 11:47:42.394866 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2114976808 Aug 10 11:47:42.394866 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User: tempest-TestMinimumBasicScenario-2114976808-project Aug 10 11:47:42.394866 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Aug 10 11:47:42.394866 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Aug 10 11:47:42.394866 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Id: 4cfca5c513604cfba864b27067799407 Aug 10 11:47:42.394866 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-TestMinimumBasicScenario-2114976808-project Aug 10 11:47:42.394866 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: method: > Aug 10 11:47:42.394866 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: exception: Instance 26420667-2913-420e-a978-d82b57dbb0fc is not attached to volume 18f95641-1718-4cba-9b1c-770a5082739e Aug 10 11:47:42.395805 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: action_args: {'server_id': '26420667-2913-420e-a978-d82b57dbb0fc', 'id': '18f95641-1718-4cba-9b1c-770a5082739e'} Aug 10 11:47:42.395805 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:47:42.395805 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:47:42.395805 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 10 11:47:42.395805 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 10 11:47:42.395805 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 11:47:42.395805 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 11:47:42.395805 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 10 11:47:42.395805 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 10 11:47:42.395805 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 18f95641-1718-4cba-9b1c-770a5082739e. Aug 10 11:47:42.395805 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:47:42.395805 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:47:42.395805 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:47:42.395805 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:47:42.395805 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:47:42.395805 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:47:42.395805 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:47:42.395805 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:47:42.395805 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:47:42.397257 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:47:42.397257 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 10 11:47:42.397257 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 10 11:47:42.397257 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26420667-2913-420e-a978-d82b57dbb0fc is not attached to volume 18f95641-1718-4cba-9b1c-770a5082739e Aug 10 11:47:42.397257 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:47:42.397257 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:47:42.397257 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:47:42.397257 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:47:42.397257 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:47:42.397257 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:47:42.397257 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:47:42.397257 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:47:42.397257 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26420667-2913-420e-a978-d82b57dbb0fc is not attached to volume 18f95641-1718-4cba-9b1c-770a5082739e Aug 10 11:47:42.397257 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:47:42.397257 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-7e64eeac-394a-4b75-a292-2f1d21dd9456 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Returning 404 to user: Instance 26420667-2913-420e-a978-d82b57dbb0fc is not attached to volume 18f95641-1718-4cba-9b1c-770a5082739e {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:47:42.398425 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-7e64eeac-394a-4b75-a292-2f1d21dd9456 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] 10.222.0.62 "DELETE /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc/os-volume_attachments/18f95641-1718-4cba-9b1c-770a5082739e" status: 404 len: 154 microversion: 2.1 time: 0.093662 Aug 10 11:47:42.398425 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 550/1100] 10.222.0.62 () {58 vars in 1416 bytes} [Wed Aug 10 11:47:42 2022] DELETE /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc/os-volume_attachments/18f95641-1718-4cba-9b1c-770a5082739e => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:47:43.648199 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-64f06e75-6213-49c3-a6da-99954261989f tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:47:43.648732 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-64f06e75-6213-49c3-a6da-99954261989f tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] [instance: 26420667-2913-420e-a978-d82b57dbb0fc] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:47:43.655915 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-64f06e75-6213-49c3-a6da-99954261989f tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:47:43.656418 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-64f06e75-6213-49c3-a6da-99954261989f tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:47:43.656890 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-64f06e75-6213-49c3-a6da-99954261989f tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:47:43.657575 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-64f06e75-6213-49c3-a6da-99954261989f tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:47:43.658028 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-64f06e75-6213-49c3-a6da-99954261989f tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:47:43.658454 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-64f06e75-6213-49c3-a6da-99954261989f tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:47:43.682348 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-64f06e75-6213-49c3-a6da-99954261989f tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] [instance: 26420667-2913-420e-a978-d82b57dbb0fc] Going to try to terminate instance {{(pid=124682) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:47:43.984960 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-64f06e75-6213-49c3-a6da-99954261989f tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] 10.222.0.62 "DELETE /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc" status: 204 len: 0 microversion: 2.1 time: 0.340209 Aug 10 11:47:43.985498 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 551/1101] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 10 11:47:43 2022] DELETE /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:47:43.993842 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-a3739fb4-7e10-46d0-a0c6-5e1eb4d7fb1c tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:47:43.998103 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-a3739fb4-7e10-46d0-a0c6-5e1eb4d7fb1c tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] [instance: 26420667-2913-420e-a978-d82b57dbb0fc] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:47:44.003141 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a3739fb4-7e10-46d0-a0c6-5e1eb4d7fb1c tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:47:44.003630 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a3739fb4-7e10-46d0-a0c6-5e1eb4d7fb1c tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:47:44.004128 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a3739fb4-7e10-46d0-a0c6-5e1eb4d7fb1c tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:47:44.004873 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a3739fb4-7e10-46d0-a0c6-5e1eb4d7fb1c tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:47:44.005321 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a3739fb4-7e10-46d0-a0c6-5e1eb4d7fb1c tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:47:44.005745 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a3739fb4-7e10-46d0-a0c6-5e1eb4d7fb1c tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:47:44.139830 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-a3739fb4-7e10-46d0-a0c6-5e1eb4d7fb1c tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfca5c513604cfba864b27067799407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1842fcd00b26484581ba3e681fdc6ecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:47:44.147836 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-a3739fb4-7e10-46d0-a0c6-5e1eb4d7fb1c tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] 10.222.0.62 "GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc" status: 200 len: 1553 microversion: 2.1 time: 0.157872 Aug 10 11:47:44.148521 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 551/1102] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:47:43 2022] GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:47:44.769190 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 11:47:44.769401 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Wed Aug 10 11:47:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 11:47:45.171376 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-99b8f07b-57a9-4d2f-bc8b-7761d318e29f tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:47:45.172134 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-99b8f07b-57a9-4d2f-bc8b-7761d318e29f tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] [instance: 26420667-2913-420e-a978-d82b57dbb0fc] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:47:45.178529 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-99b8f07b-57a9-4d2f-bc8b-7761d318e29f tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:47:45.179006 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-99b8f07b-57a9-4d2f-bc8b-7761d318e29f tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:47:45.179437 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-99b8f07b-57a9-4d2f-bc8b-7761d318e29f tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:47:45.180164 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-99b8f07b-57a9-4d2f-bc8b-7761d318e29f tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:47:45.180615 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-99b8f07b-57a9-4d2f-bc8b-7761d318e29f tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:47:45.181035 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-99b8f07b-57a9-4d2f-bc8b-7761d318e29f tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:47:45.419469 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-99b8f07b-57a9-4d2f-bc8b-7761d318e29f tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfca5c513604cfba864b27067799407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1842fcd00b26484581ba3e681fdc6ecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:47:45.427107 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-99b8f07b-57a9-4d2f-bc8b-7761d318e29f tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] 10.222.0.62 "GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc" status: 200 len: 1553 microversion: 2.1 time: 0.260579 Aug 10 11:47:45.427620 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 552/1103] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:47:45 2022] GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc => generated 1553 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:47:46.166959 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-9a76b433-9da3-417e-b54d-adf073fd8ad3 req-f24a5f04-baf2-4f25-aa1c-8f65f8d9aa83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26420667-2913-420e-a978-d82b57dbb0fc", "name": "network-vif-deleted", "tag": "664bc1b1-0740-4b33-a697-a2970a2f2249"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:47:46.178138 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-9a76b433-9da3-417e-b54d-adf073fd8ad3 req-f24a5f04-baf2-4f25-aa1c-8f65f8d9aa83 service nova] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:47:46.179292 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-9a76b433-9da3-417e-b54d-adf073fd8ad3 req-f24a5f04-baf2-4f25-aa1c-8f65f8d9aa83 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:47:46.179292 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-9a76b433-9da3-417e-b54d-adf073fd8ad3 req-f24a5f04-baf2-4f25-aa1c-8f65f8d9aa83 service nova] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:47:46.189900 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-9a76b433-9da3-417e-b54d-adf073fd8ad3 req-f24a5f04-baf2-4f25-aa1c-8f65f8d9aa83 service nova] Creating event network-vif-deleted:664bc1b1-0740-4b33-a697-a2970a2f2249 for instance 26420667-2913-420e-a978-d82b57dbb0fc on hv-cinder-85272 Aug 10 11:47:46.194864 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-9a76b433-9da3-417e-b54d-adf073fd8ad3 req-f24a5f04-baf2-4f25-aa1c-8f65f8d9aa83 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031713 Aug 10 11:47:46.195447 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 552/1104] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 10 11:47:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:47:46.448600 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-ed686043-147d-47b4-97d0-333e43c3d2c4 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:47:46.449218 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-ed686043-147d-47b4-97d0-333e43c3d2c4 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] [instance: 26420667-2913-420e-a978-d82b57dbb0fc] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:47:46.456631 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ed686043-147d-47b4-97d0-333e43c3d2c4 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:47:46.457119 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ed686043-147d-47b4-97d0-333e43c3d2c4 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:47:46.457559 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ed686043-147d-47b4-97d0-333e43c3d2c4 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:47:46.458269 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ed686043-147d-47b4-97d0-333e43c3d2c4 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:47:46.458740 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ed686043-147d-47b4-97d0-333e43c3d2c4 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:47:46.459484 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ed686043-147d-47b4-97d0-333e43c3d2c4 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:47:46.493861 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ed686043-147d-47b4-97d0-333e43c3d2c4 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:47:46.494356 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ed686043-147d-47b4-97d0-333e43c3d2c4 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:47:46.494800 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ed686043-147d-47b4-97d0-333e43c3d2c4 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:47:46.495238 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.objects.instance [None req-ed686043-147d-47b4-97d0-333e43c3d2c4 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lazy-loading 'fault' on Instance uuid 26420667-2913-420e-a978-d82b57dbb0fc {{(pid=124682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:47:46.537880 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-ed686043-147d-47b4-97d0-333e43c3d2c4 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfca5c513604cfba864b27067799407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1842fcd00b26484581ba3e681fdc6ecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:47:46.546140 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-ed686043-147d-47b4-97d0-333e43c3d2c4 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] 10.222.0.62 "GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc" status: 200 len: 1348 microversion: 2.1 time: 0.101452 Aug 10 11:47:46.546735 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 553/1105] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:47:46 2022] GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc => generated 1348 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:47:47.568133 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-c8dc11c3-332e-4a0d-9611-e28bde8998ea tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:47:47.568755 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-c8dc11c3-332e-4a0d-9611-e28bde8998ea tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] [instance: 26420667-2913-420e-a978-d82b57dbb0fc] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:47:47.574888 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c8dc11c3-332e-4a0d-9611-e28bde8998ea tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:47:47.576008 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c8dc11c3-332e-4a0d-9611-e28bde8998ea tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:47:47.576456 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c8dc11c3-332e-4a0d-9611-e28bde8998ea tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:47:47.577144 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c8dc11c3-332e-4a0d-9611-e28bde8998ea tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Acquiring lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:47:47.577605 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c8dc11c3-332e-4a0d-9611-e28bde8998ea tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:47:47.578030 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c8dc11c3-332e-4a0d-9611-e28bde8998ea tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Lock "57932da1-fc7c-42ec-b0c9-ecc094a8eac1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:47:47.591133 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-c8dc11c3-332e-4a0d-9611-e28bde8998ea tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] HTTP exception thrown: Instance 26420667-2913-420e-a978-d82b57dbb0fc could not be found. Aug 10 11:47:47.592770 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-c8dc11c3-332e-4a0d-9611-e28bde8998ea tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Request method failure captured: Aug 10 11:47:47.592770 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: request: GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc HTTP/1.1 Aug 10 11:47:47.592770 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept: application/json Aug 10 11:47:47.592770 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Aug 10 11:47:47.592770 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Connection: close Aug 10 11:47:47.592770 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Length: 0 Aug 10 11:47:47.592770 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Content-Type: application/json Aug 10 11:47:47.592770 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Host: 10.222.0.62 Aug 10 11:47:47.592770 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Aug 10 11:47:47.592770 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.11 Aug 10 11:47:47.592770 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABi85phy23f4aAZWo7YNWVa_92iQqiUtOCjJ7zLUroYCQENWswxqO3pNhSTCB1IHN1i_dO-7orr0vHFwxvNgiysk587VuYzfLEv9lABxoMLcHpQ4epPww2OB15Oi890IjQJV-NuQwkS022CdpGWgFOwpb42JNzdY0m2f1cOpZ6w3nMDaFk Aug 10 11:47:47.592770 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Aug 10 11:47:47.592770 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Aug 10 11:47:47.592770 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Aug 10 11:47:47.592770 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Aug 10 11:47:47.592770 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Aug 10 11:47:47.592770 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Aug 10 11:47:47.592770 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Id: 1842fcd00b26484581ba3e681fdc6ecd Aug 10 11:47:47.592770 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-TestMinimumBasicScenario-2114976808 Aug 10 11:47:47.592770 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Role: member,reader Aug 10 11:47:47.592770 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Aug 10 11:47:47.594564 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1842fcd00b26484581ba3e681fdc6ecd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1842fcd00b26484581ba3e681fdc6ecd", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1842fcd00b26484581ba3e681fdc6ecd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1842fcd00b26484581ba3e681fdc6ecd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 10 11:47:47.594564 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-TestMinimumBasicScenario-2114976808 Aug 10 11:47:47.594564 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Id: 1842fcd00b26484581ba3e681fdc6ecd Aug 10 11:47:47.594564 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2114976808 Aug 10 11:47:47.594564 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User: tempest-TestMinimumBasicScenario-2114976808-project Aug 10 11:47:47.594564 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Aug 10 11:47:47.594564 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Aug 10 11:47:47.594564 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Id: 4cfca5c513604cfba864b27067799407 Aug 10 11:47:47.594564 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-TestMinimumBasicScenario-2114976808-project Aug 10 11:47:47.594564 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: method: > Aug 10 11:47:47.594564 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: exception: Instance 26420667-2913-420e-a978-d82b57dbb0fc could not be found. Aug 10 11:47:47.594564 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: action_args: {'id': '26420667-2913-420e-a978-d82b57dbb0fc'} Aug 10 11:47:47.595613 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:47:47.595613 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:47:47.595613 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:47:47.595613 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:47:47.595613 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:47:47.595613 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:47:47.595613 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:47:47.595613 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:47:47.595613 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:47:47.595613 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:47:47.595613 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26420667-2913-420e-a978-d82b57dbb0fc could not be found. Aug 10 11:47:47.595613 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:47:47.595613 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:47:47.595613 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:47:47.595613 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:47:47.595613 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:47:47.595613 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:47:47.595613 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:47:47.595613 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:47:47.595613 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:47:47.597465 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:47:47.597465 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:47:47.597465 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:47:47.597465 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:47:47.597465 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:47:47.597465 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:47:47.597465 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:47:47.597465 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26420667-2913-420e-a978-d82b57dbb0fc could not be found. Aug 10 11:47:47.597465 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:47:47.597465 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:47:47.597465 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:47:47.597465 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:47:47.597465 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:47:47.597465 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:47:47.597465 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:47:47.597465 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:47:47.597465 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26420667-2913-420e-a978-d82b57dbb0fc could not be found. Aug 10 11:47:47.597465 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Aug 10 11:47:47.599055 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-c8dc11c3-332e-4a0d-9611-e28bde8998ea tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Returning 404 to user: Instance 26420667-2913-420e-a978-d82b57dbb0fc could not be found. {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:47:47.599055 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-c8dc11c3-332e-4a0d-9611-e28bde8998ea tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] 10.222.0.62 "GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc" status: 404 len: 111 microversion: 2.1 time: 0.030885 Aug 10 11:47:47.599055 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 553/1106] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 10 11:47:47 2022] GET /compute/v2.1/servers/26420667-2913-420e-a978-d82b57dbb0fc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:47:47.602804 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-5a2cd786-48de-43f6-8743-9f1d5e1761a5 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] Calling method '.version_select at 0x7fb7ce8f7d30>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:47:47.685494 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-5a2cd786-48de-43f6-8743-9f1d5e1761a5 tempest-TestMinimumBasicScenario-2114976808 tempest-TestMinimumBasicScenario-2114976808-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1010971622" status: 202 len: 0 microversion: 2.1 time: 0.086335 Aug 10 11:47:47.686070 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 554/1107] 10.222.0.62 () {58 vars in 1272 bytes} [Wed Aug 10 11:47:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1010971622 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:47:50.833054 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 11:47:50.833655 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Wed Aug 10 11:47:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 11:50:27.165830 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 11:50:27.166533 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Wed Aug 10 11:50:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 11:51:04.777265 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 11:51:04.777785 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Wed Aug 10 11:51:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 11:51:10.841415 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 11:51:10.841992 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Wed Aug 10 11:51:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 11:51:15.788762 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 11:51:15.789433 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Wed Aug 10 11:51:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 11:53:08.216716 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 11:53:08.217357 dv-cinder-852725-3-iscsi devstack@n-api.service[124683]: Wed Aug 10 11:53:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 11:53:08.420115 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 11:53:08.420686 dv-cinder-852725-3-iscsi devstack@n-api.service[124682]: Wed Aug 10 11:53:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!